Patients must have had HER testing performed on the primary breast tumor before neoadjuvant chemotherapy according to the current ASCO/CAP guideline recommendations for human epidermal growth factor receptor testing in breast cancer; patients who have a primary tumor that is either HER-positive or HER-negative are eligible Estrogen receptor (ER), progesterone receptor (PR), and human epidermal growth factor receptor (HER) testing performed on the primary breast tumor; when applicable, testing must have been performed prior to neoadjuvant chemotherapy Metastatic or locally advanced, histologically documented TNBC characterized by absence of human epidermal growth factor (HER), estrogen receptor (ER), and progesterone receptor (PR) expression No prior anti-epidermal growth factor (EGF) or anti-human epidermal growth factor receptor (HER) therapy Only for the L Cohort: human epidermal growth factor receptor (HER)-negative tumors; Participants with locally advanced or metastatic, histologically documented TNBC (absence of human epidermal growth factor receptor [HER], estrogen receptor [ER], and progesterone receptor [PR] expression), not amenable to surgical therapy SAFETY RUN-IN: Women diagnosed with pathologically confirmed metastatic triple negative invasive breast cancer (centrally confirmed immunophenotype negative for all three receptors estrogen receptor [ER], progesterone receptor [PR] and human epidermal growth factor receptor [HER]) For Part B exclusively (RO in combination with trastuzumab), participants with metastatic or recurrent or locally advanced human epidermal growth factor receptor (HER)-positive breast cancer, as defined by the College of American Pathologists HER testing guidelines, who have progressed on at least two lines of HER-directed therapies in the metastatic setting and the last therapy prior to going on study has to contain a HER-directed antibody; baseline left ventricular ejection fraction (LVEF) of >=% (measured by echocardiography) predose on Cycle Day Have a diagnosis of hormone receptor positive (HR+), human epidermal growth factor receptor (HER) negative metastatic breast cancer for Parts A to E, G, and I. Have a diagnosis of human epidermal growth factor receptor (HER) positive metastatic breast cancer for Parts F and H. Have a diagnosis of Hormone Receptor Positive (HR+), Human Epidermal Growth Factor Receptor Negative (HER-) breast cancer Prior combined CDK / inhibitor and endocrine therapy and or prior lines of chemotherapy Histologically documented TNBC (negative human epidermal growth factor receptor [HER], estrogen receptor [ER], and progesterone receptor [PgR] status) Part , Cohort , Postmenopausal women with hormone receptor (HR)-positive, human epidermal growth factor receptor (HER)-negative advanced or metastatic breast cancer who have failed prior treatment with a CDK / inhibitor in combination with an aromatase inhibitor (AI) as initial endocrine-based therapy. Histologically confirmed estrogen receptor (ER)-negative, progesterone receptor (PR)-negative, and human epidermal growth factor (HER)-negative adenocarcinoma of the breast with measurable metastatic or locally advanced disease Patients enrolling in the triple negative breast cancer (estrogen receptor negative [ER-]/progesterone receptor negative [PR-]/human epidermal growth factor receptor negative [Her-]) group, cohort , must have a negative family history of HBOC syndrome, or negative gBRCA/m test; a family history of HBOC is defined by National Comprehensive Cancer Network (NCCN) Genetic/Familial High-Risk Assessment: Breast and Ovarian guideline Locally tested, Human Epidermal Growth Factor Receptor (HER)-expressing BC For triple-negative breast cancer, a minimum of prior cytotoxic chemotherapy regimen must have been administered for the indication of metastatic disease.Depending on receptor status, or prior cytotoxic regimens are required prior to enrollment in this trial; hormonal and/or human epidermal growth factor receptor (HER) -targeted agents may be required. Documentation of estrogen receptor positive ((ER+), human epidermal growth factor receptor (HER negative (HER-)) tumor. Must have a confirmed Epidermal growth factor receptor amplification in tumor tissue Human epidermal growth factor (HER) positive and estrogen receptor (ER) or progesterone receptor (PR) positive tumors: must be refractory to hormonal therapy (e.g. aromatase inhibitor, tamoxifen or fluvestrant) and previously treated with at least regimens containing at least two anti-HER agents (e.g. trastuzumab and pertuzumab). Have documented testing for human epidermal growth factor receptor (HER-neu) overexpressing, and for those with tumors overexpressing HER-neu, have documented progression on Trastuzumab-containing therapy Dose Expansion Cohort Group and : Patients must have a diagnosis of histologically confirmed metastatic TNBC defined as negative for estrogen receptor, progesterone receptor and human epidermal growth factor receptor (HER); patients must have received either adjuvant chemotherapy or first line chemotherapy for metastatic disease; negative for estrogen and progesterone receptor includes the following:\r\n* Local pathology report classifies them as negative\r\n* Allred score of or below\r\n* < % positive staining Patient must have histologically or cytologically confirmed breast cancer that is now metastatic; any estrogen receptor (ER), progesterone receptor (PR) or human epidermal growth factor receptor (HER) status is allowed PHASE II STUDY COHORT TRIPLE NEGATIVE BREAST CANCER ELIGIBILITY CRITERIA (MEDI+O ONLY)\r\nPatients must have histologically confirmed persistent or recurrent triple-negative breast cancer (TNBC) for which standard curative measures do not exist or are no longer effective; estrogen receptor (ER)/progesterone receptor (PR)/human epidermal growth factor receptor (HER) status needs to be documented either by an outside source or at National Cancer Institute (NCI) Estrogen receptor positive (ER+), human epidermal growth factor receptor negative (HER-) (HER status is not required for women diagnosed with DCIS) COHORT II: Core tissue must have human epidermal growth factor receptor (HER ) testing Human epidermal growth factor receptor (HER)-neu positive Step subjects only: newly diagnosed, operable, triple negative breast cancer, i.e. estrogen receptor (ER)/progesterone receptor (PR)-negative, human epidermal growth factor receptor (her)/neu-negative, with tumor size between cm (T) as measured by either clinical breast exam, mammogram, ultrasound or magnetic resonance imaging (MRI), with or without ipsilateral axilla node involvement (N or N) Have either human epidermal growth factor receptor positive (HER+) (Study Part A) or HER- (Study Part B) breast cancer. Immunohistochemical studies must demonstrate the invasive component of the tumor to be estrogen receptor positive (ER+) (>= %) or progesterone receptor positive (PR+), human epidermal growth factor receptor negative (HER-) and grade or Pathologically confirmed squamous cell carcinoma of the head and neck OR pathologically confirmed invasive breast adenocarcinoma with documented estrogen receptor (ER)/progesterone receptor (PR)/human epidermal growth factor receptor (HER) status and radiographic evidence of distant metastatic disease Patients who are found to have a cancer positive for the marker human epidermal growth factor receptor (HER-)/neu (Note: this exclusion criterion applies only to patients at the New York University [NYU] Tisch and Bellevue sites where there is currently a protocol open and available for patients who are HER-/neu positive; this exclusion criterion does not apply to patients at the South Africa site) Patients with human epidermal growth factor receptor (HER)-positive advanced breast cancer or ovarian cancer should have received at least two lines of systemic therapy in the advanced setting Patients with prior anti-epidermal growth-factor receptor antibody therapy (antibody or small molecule) Any estrogen receptor (ER), progesterone receptor (PR), or human epidermal growth factor receptor (Herneu) status as long as the patient will receive nab-paclitaxel alone Prior therapy with any agent targeting the HER pathway or human epidermal growth factor receptor (HER) (epidermal growth factor receptor [EGFR]) pathway Histologically confirmed diagnosis of recurrent or residual epithelial ovarian cancer, primary peritoneal carcinoma or fallopian tube carcinoma, OR histologically confirmed metastatic breast cancer, that is estrogen receptor (ER)-negative, progesterone receptor (PR)-negative, and human epidermal growth factor receptor (HER)/neu negative (as determined by local pathology laboratory) Patients with prior anti-epidermal growth-factor receptor antibody therapy (antibody or small molecule) Patients who have received prior therapy with trastuzumab or any other anti-epidermal growth factor type II receptor antibody Plan to administer any other systemic antitumor including endocrine therapy except for following standard of care treatment:\r\n* Trastuzumab at standard dosing human epidermal growth factor receptor (HER) positive tumors\r\n* Denosumab or bisphosphonates to treat metastatic bone disease Tumor shown to be human epidermal growth factor plus (HER+) Metastatic Breast Cancer: Human Epidermal Growth Factor Receptor - negative (HER(-)) recurrent Metastatic Breast Cancer: Human epidermal growth factor receptor (HER)-negative tumor (primary tumor or metastatic lesion) Human Epidermal Growth Factor Receptor (HER)-positive gastric cancer Estrogen Receptor (ER)-, Progesterone Receptor (PR)-, and Human Epidermal Growth Factor Receptor (HER)-negative (triple-negative) cancer of the breast. Estrogen receptor (ER), progesterone receptor (PR) and human epidermal growth factor receptor (HER) testing in progress (i.e. on outside or MSKCC biopsy report)\r\n* HER-positive pathology is permitted Patients may have any molecular status (estrogen receptor [ER], progesterone receptor [PR] and human epidermal growth factor receptor [HER]) and must have failed at least systemic regimen after their diagnosis of locoregional disease Histological or cytological evidence of estrogen-receptor negative (ER-), progesterone receptor negative (PgR-) and human epidermal growth factor- receptor negative (HER-) Breast Cancer by local laboratory testing, based on last available tumor tissue. Participants with human epidermal growth factor receptor (HER)-positive status. Have a diagnosis of hormone receptor-positive (HR+), human epidermal growth factor receptor -negative (HER-) breast cancer Known Human Epidermal Growth Factor Receptor (HER) positive, erythrocyte receptor (ER) positive, or progesterone receptor (PR) positive breast cancer Invasive ductal, lobular, medullary, papillary, colloid (mucinous), tubular histologies, or mixed histologies (lesions =< cm) that are estrogen or progesterone receptor positive and do not exhibit human epidermal growth factor receptor (HER)/neu gene amplification OR ductal carcinoma in situ (lesions =< cm) Human epidermal growth factor receptor (HER-) status may be pending at initiation of FOLFIRINOX, but must be known prior to starting trastuzumab; if HER- is positive, patients must have a left ventricular ejection fraction (LVEF) >= %; HER- negative patients are not excluded Documentation of human epidermal growth factor receptor (HER)-negative tumor. The patient must have a pathologically confirmed (by histology, cytology, or immunohistology) diagnosis of TNBC (a cancer that does not meaningfully express the estrogen or progesterone hormone receptors or overexpress the human epidermal growth factor receptor tyrosine kinase), which is currently advanced/metastatic disease. Men and women with advanced malignancies for which no standard therapy is available\r\n* Dose escalation: Patients with any solid tumor malignancies \r\n* Dose expansion: \r\n** Patients with advanced malignancies that have germline and/or somatic BRCA mutations (cohort gBRCA) or\r\n** Triple negative (TN) metastatic breast cancer without known BRCA mutation (cohort TNBC); tumors will be considered TN when:\r\n*** Estrogen receptor (ER) expression < %\r\n*** Progesterone receptor (PR) expression < %\r\n*** Human epidermal growth factor receptor (Her) negative as per the American Society of Clinical Oncology (ASCO) guidelines\r\n** Paclitaxel expansion: any solid tumor malignancy with potential benefit from this combination and paclitaxel (ASP) Human epidermal growth factor receptor (HER-) positive esophagogastric cancer; patients with unknown HER status are permitted Histologically confirmed invasive breast carcinoma, stage I-III\r\n* Note: estrogen receptor (ER), progesterone receptor (PR) and human epidermal growth factor receptor (HER) status must be known; in newly diagnosed patients planning neoadjuvant treatment, a formal assessment of axillary lymph nodes is not required Patients with both ER positive and ER negative breast cancer are eligible for this study; patients with human epidermal growth factor receptor (HER) positive disease will be excluded from participation in this study Participants must have histologically confirmed hormone receptor positive (HR+), human epidermal growth factor (HER) negative stage II or stage III invasive breast cancer; evaluation for metastatic disease is not required in the absence of symptoms Histologically documented HR+ breast cancer in either the primary or metastatic setting, as defined by estrogen receptor (ER) + or progesterone receptor (PR) +; results from the local lab are acceptable; eligibility will not be affected by human epidermal growth factor (HER) status Histologically or cytologically confirmed estrogen/progesterone receptors (ER/PR) +/-; human epidermal growth factor receptor (HER)-, metastatic breast cancer. Histological or cytological confirmation of estrogen-receptor positive (ER+) human epidermal growth factor receptor negative (HER-) breast cancer If Human Epidermal Growth Factor Receptor (HER) positive, subjects must have received and progressed on at least one prior standard HER directed therapy or the subject must be ineligible to receive anti-HER therapy. Prior treatment with epidermal growth factor receptor targeting small molecules or antibodies. At the recommended phase II dose level, a total of patients with triple-negative breast cancer defined as estrogen receptor (ER)-negative, progesterone receptor (PR)-negative, and human epidermal growth factor receptor (HER)-negative, will be enrolled and another patients with a solid malignancy who would benefit from a paclitaxel and carboplatin-based regimen, will also be enrolled Patient must have histologically or cytologically-confirmed metastatic breast cancer; any estrogen receptor (ER), progesterone receptor (PR) or human epidermal growth factor receptor (Her) status is allowed Prior anti-epidermal growth factor receptor antibody therapy (e.g. panitumumab or cetuximab) or prior small molecule anti-epidermal growth factor receptor therapy (e.g. erlotinib) for adenocarcinoma of the small bowel or ampulla of Vater Confirmed diagnosis of: \r\n* Postmenopausal advanced hormone receptor-positive, human epidermal growth factor receptor (HER)-negative breast cancer after failure of treatment with letrozole or anastrozole\r\n* Progressive neuroendocrine tumors of pancreatic origin (PNET) that is unresectable, locally advanced or metastatic\r\n* Advanced renal cell carcinoma (RCC) after failure of treatment with sunitinib or sorafenib Human epidermal growth factor receptor (HER)/neu negative on the core biopsy analysis defined as or + by immunohistochemistry or not amplified by fluorescent in situ hybridization analysis Known human epidermal growth factor (HER)-positive, estrogen receptor (ER)-positive, or progesterone receptor (PgR)-positive breast cancer Estrogen receptor-positive (ER+) and human epidermal growth factor receptor -negative (HER-) breast cancer Women with ER+/progesterone receptor positive (PR+) human epidermal growth factor receptor (HER)-negative breast cancer initiating neoadjuvant endocrine therapy with curative intent OR initiating endocrine therapy for the treatment of metastatic breast cancer with a biopsy accessible primary breast tumor There should be a minimum of weeks from any prior chemotherapy, immunotherapy and/or radiation, with the exception of hormonal therapy for prostate and breast cancers, human epidermal growth factor receptor (HER)-directed therapy for HER+ breast cancer (+ immunohistochemistry [IHC] or fluorescence in situ hybridization [FISH]+), and erlotinib in epidermal growth factor receptor (EGFR)-mutated lung cancer in the expansion cohort; there should be a minimum of weeks from any prior antibody therapies, (such as ipilimumab or anti-programmed cell death [PD]/programmed death-ligand [PDL]) Prior treatment with an investigational or approved agent for the purpose of inhibiting human epidermal growth factor receptor (HER) family members. This includes, but is not limited to, cetuximab, panitumumab, erlotinib, gefitinib, and lapatinib Patients with human epidermal growth factor receptor positive (HER+) breast cancer are also excluded from this portion of the study Triple negative breast cancer (TNBC) Cohort: Participants with histologically confirmed incurable, advanced estrogen receptor (ER)-negative, progesterone receptor-negative, and human epidermal growth factor receptor (HER)-negative adenocarcinoma of the breast (triple-negative) not previously treated with anti-PD-L/PD- and/or anti-CTLA- (investigational or approved) Prior treatment with any anti-HER (Human Epidermal growth factor Receptor ) treatment For Stage : Participants with human epidermal growth factor receptor (HER) negative, estrogen-receptor (ER) negative, and progesterone-receptor (PR) negative breast cancer Estrogen receptor (ER)-positive disease and human epidermal receptor (HER)-negative disease Human epidermal growth factor receptor (HER-)/neu negative (phase II) Paraffin-embedded tumor tissue from primary tumor or metastasis for determination of epidermal growth factor receptor expression and biomarker testing Completed adjuvant taxane-based chemotherapy as single agents or in combination with platins or human epidermal growth factor receptor (HER-) directed therapy Diagnosed with triple negative (negative for estrogen receptor, progesterone receptor and not human epidermal growth factor receptor [Her] amplified) breast cancer at or younger Have histologic diagnosis of human epidermal growth factor receptor (HER) positive (+) breast carcinoma Patients with triple negative breast cancer (estrogen receptor-negative (ER-), progesterone receptor-negative (PR-), and human epidermal growth factor receptor -negative (Her-) must also meet the following criteria: a. Must have received at least one prior chemotherapy regimen for locally advanced or metastatic disease; b. Must have received prior taxane therapy. Histological or cytological confirmation of hormone-receptor positive (HR+) human epidermal growth factor receptor negative (HER-) breast cancer Patients must have had HER testing performed on the primary breast tumor collected prior to neoadjuvant chemotherapy according to the current ASCO/CAP guideline recommendations for human epidermal growth factor receptor testing in breast cancer; patients who have a primary tumor that is HER-positive, HER-equivocal, or HER-negative are eligible Patient must NOT have human epidermal growth factor- positive (HER+) metastatic disease Patients with human epidermal growth factor- positive (HER+) metastatic tumors are NOT eligible. Patient must NOT be planning to receive everolimus nor human epidermal growth factor receptor (HER) directed therapy in addition to endocrine therapy. Participants must have histologically or cytologically confirmed human epidermal growth factor receptor (HER) negative invasive breast adenocarcinoma Histologic diagnosis of triple negative or human epidermal growth factor receptor (HER) amplified breast cancer, clinical stage T-, N-, M/ receiving preoperative systemic therapy and planned surgery Triple-negative disease (estrogen receptor, progesterone receptor, and human epidermal growth factor receptor (HER) negativity confirmed on a histological biopsy of a metastatic tumor lesion (receptor conversion not allowed).