Participants may not have received any prior treatment with therapies targeting PDL, PD or CTLA Cohort B Safety Run-In (Ribociclib + PDR + Fulvestrant): Treatment with prior PD/PDL/CTLA inhibitors is prohibited Cohort A Dose Expansion (Ribociclib + PDR): Treatment with prior PD/PDL/CTLA is prohibited Expansion Cohort B (Ribociclib + PDR + Fulvestrant): Treatment with prior PD/PDL/CTLA inhibitors are prohibited Treatment with nivolumab or any PDL or PDL-directed antibody within weeks of the start of study drug. Patients should have been off conventional therapy for at least week prior to entry in this study; PD/PDL inhibitors will be allowed if medically indicated Have received an anti-PD or anti PDL monoclonal antibody Refractory patients who are nave to anti-PD-/PDL- therapy OR Relapsed after or more lines of therapies; and are nave to anti-PD-/PDL- therapy OR Patients must have prior exposure to an anti-PD or anti-PDL mAb, if eligible for immunotherapy in the judgment of the local investigator Prior treatment with any PD- or PDL- inhibitor Patients must have received at least one prior chemotherapy regimen and up to any number of prior systemic regimens including chemotherapy and molecular targeted therapy other than PD/ PDL/ PDL inhibitors No history of prior treatment with inhibitor of PD- or PD-L or PDL Patients must not have received prior pembrolizumab or other anti-PD/PDL therapies for their metastatic disease Patients with PDL level of >= %, who do not have an ALK-rearrangement or EGFR-mutation, must have progressed or been intolerant to treatment with anti-PD/PDL therapy (pembrolizumab, nivolumab, or atezolizumab) Patients tumors must be documented to be microsatellite-stable (MSS) either by genetic analysis or immunohistochemistry OR microsatellite-high with documented disease progression following anti-PD/PDL therapy Participants previously treated with BRAF inhibitors (vemurafenib, dabrafenib, encorafenib), MEK inhibitors (selumetinib, trametinib, binimetinib, cobimetinib), and/or anti-PD/PDL monoclonal antibodies for metastatic or unresectable disease; any other prior therapy will be allowed (including ipilimumab, adjuvant anti-PD therapy, high-dose IL-) Patients with prior known toxicity attributed to PD- or PDL- directed therapy, which led to discontinuation of these agents, will be excluded from the PDR containing arms of the study. Colorectal patients are excluded if they have had prior systemic treatment with an anti-CTLA, anti-PD or PDL antibody; pancreatic patients are excluded if they have previously received anti-CTLA- therapy; prior PD- or PDL therapy will be permitted for pancreas patients Must have progression of disease within months of study enrollment after treatment with only one of the following:\r\n* Two prior lines of therapy: a VEGF inhibitor (other than axitinib), followed by a single agent PD-/PDL- antibody, or\r\n* One prior line of therapy: combination of a VEGF inhibitor (other than axitinib) AND a PD/PDL antibody, or Acceptable marrow function and hematologic indices for PD/PDL immune checkpoint inhibitor and nelfinavir as per standard of care Allergy or intolerance to nelfinavir or selected PD/PDL immune checkpoint inhibitor Tumor progression or recurrence during or after treatment with anti-PD, anti-PDL, anti-PDL, anti-CTLA, or other immune checkpoint inhibitor where the most recent dose was given within months prior to study registration Patients who have previously been treated with avelumab (or another PD/PDL inhibitor) in combination with -azacytidine will be excluded Prior treatment with nivolumab or any other PD/PDL checkpoint inhibitor Patients must not have had prior treatment with nivolumab or any other PDL or PD- antagonists Patients enrolled on the phase II randomized trial, who have had prior treatment with a PD or PDL inhibitor, anti-CTLA antibody or any other antibody or drug that specifically targets immune checkpoint pathway (i.e. not immune therapy naive)\r\n* Note: for those enrolled in the phase I dose escalation, prior use of a PD or PDL, anti-CTLA antibody or any other antibody or drug that specifically targets immune checkpoint pathway is allowed; for those enrolled in the phase IB, prior use of a PD or PDL, anti-CTLA antibody or any other antibody or drug that specifically targets immune checkpoint pathway is required; for all patients in all phases, prior use of a vaccine for treatment of cancer is allowed Patients enrolled in the phase Ib expansion who have never previously been treated with a PD or PDL inhibitor, anti-CTLA antibody or any other antibody or drug that specifically targets immune checkpoint pathway in the past (i.e. not \pre-treated) Prior exposure to immunotherapy including, but not limited to, anti-PD or anti-PDL antibodies is allowed but not required. Patients must have received prior treatment with chemotherapy. Chemotherapy may have previously been given with a PD- or PDL- inhibitor. Patients must not be on any other systemic therapy within the following intervals before study enrollment:\r\n* week after stereotactic radiosurgery of the brain or comparable technology\r\n* weeks after cytotoxic chemotherapy or external beam radiation therapy\r\n* weeks after chemotherapy regimens including BCNU (carmustine) or mitomycin C\r\n* Patients who experience melanoma progression (by Response Evaluation Criteria in Solid Tumors [RECIST] . criteria) while on or after treatment with programmed cell death (PD-) or PD ligand- (PDL-) antibody may enroll on this study\r\n** NOTE: Patients must be off PD-/PDL- antibody for at least weeks to assess for delayed toxicity before being enrolled and receiving INCB; patients who are enrolled weeks and up to weeks after the last dose of PD-/PDL- antibody will enroll in cohort B and receive mg BID of INCB; patients enrolled beyond the week period after failing anti-PD-/PDL- will be enrolled in cohort A; cohort A patients will receive mg BID of INCB; patients must not have active grade autoimmune toxicities attributed to these antibodies at study entry\r\n* weeks after ipilimumab, other cytotoxic T-lymphocyte-associated protein (CTLA-) antibody or other immunologically active antibody\r\n** NOTE: Patients receiving prior CTLA-, anti-PD antibody or other immunologic therapy must show evidence of normal pituitary function at baseline and must not have active grade autoimmune toxicities attributed to these antibodies at study entry Ipilimumab or other immunologically active therapy within weeks of enrollment; NOTE: patients who experience melanoma progression (by RECIST . criteria) while on or after treatment with PD- or PDL- antibody may enroll on this study PRIOR/CONCURRENT THERAPY CRITERIA: Prior treatment with an anti-PD- or anti-PDL is not required Subjects who have received prior therapy with regimens containing CTLA-, PDL-, or PD- antagonists are NOT permitted to enroll unless all of the following apply: Prior exposure to ALK receptor tyrosine kinase inhibitor, anti-PD, anti-PDL or any drug targeting T-cell checkpoint pathways. Patients currently receiving treatment for concurrent active malignancy; prior immunotherapy with checkpoint blockade (i.e., PD inhibitor, PDL inhibitor, or CTL-antagonist or similar agent) must have been completed more than month prior to the T-cell infusion Patients currently receiving treatment for concurrent active malignancy; continuation of hormonal therapy (i.e. for breast cancer) is acceptable; prior immunotherapy with checkpoint blockade (i.e. PD inhibitor, PDL inhibitor or CTL-antagonist or similar agent) must have been completed more than month prior to the T cell infusion Histologically or cytologically documented cancer to which anti-PD or anti-PDL are approved therapies Patients that plan to receive off-label use of anti-PD or anti-PDL