| 1. |
- Abdou, Mostafa, et al.
(författare)
-
Word Order Does Matter (And Shuffled Language Models Know It)
- 2022
-
Ingår i: PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1. - : Association for Computational Linguistics. - 9781955917216 ; , s. 6907-6919
-
Konferensbidrag (refereegranskat)abstract
- Recent studies have shown that language models pretrained and/or fine-tuned on randomly permuted sentences exhibit competitive performance on GLUE, putting into question the importance of word order information. Somewhat counter-intuitively, some of these studies also report that position embeddings appear to be crucial for models' good performance with shuffled text. We probe these language models for word order information and investigate what position embeddings learned from shuffled text encode, showing that these models retain information pertaining to the original, naturalistic word order. We show this is in part due to a subtlety in how shuffling is implemented in previous work - before rather than after subword segmentation. Surprisingly, we find even Language models trained on text shuffled after subword segmentation retain some semblance of information about word order because of the statistical dependencies between sentence length and unigram probabilities. Finally, we show that beyond GLUE, a variety of language understanding tasks do require word order information, often to an extent that cannot be learned through fine-tuning.
|
|
| 2. |
- Alimohammadi, Mohammad, et al.
(författare)
-
Pulmonary Autoimmunity as a Feature of Autoimmune Polyendocrine Syndrome Type 1 and Identification of KCNRG as a Bronchial Autoantigen
- 2009
-
Ingår i: Proceedings of the National Academy of Sciences of the United States of America. - : Proceedings of the National Academy of Sciences. - 0027-8424 .- 1091-6490. ; 106:11, s. 4396-4401
-
Tidskriftsartikel (refereegranskat)abstract
- Patients with autoimmune polyendocrine syndrome type 1 (APS-1) suffer from multiple organ-specific autoimmunity with autoantibodies against target tissue-specific autoantigens. Endocrine and nonendocrine organs such as skin, hair follicles, and liver are targeted by the immune system. Despite sporadic observations of pulmonary symptoms among APS-1 patients, an autoimmune mechanism for pulmonary involvement has not been elucidated. We report here on a subset of APS-1 patients with respiratory symptoms. Eight patients with pulmonary involvement were identified. Severe airway obstruction was found in 4 patients, leading to death in 2. Immunoscreening of a cDNA library using serum samples from a patient with APS-1 and obstructive respiratory symptoms identified a putative potassium channel regulator (KCNRG) as a pulmonary autoantigen. Reactivity to recombinant KCNRG was assessed in 110 APS-1 patients by using immunoprecipitation. Autoantibodies to KCNRG were present in 7 of the 8 patients with respiratory symptoms, but in only 1 of 102 APS-1 patients without respiratory symptoms. Expression of KCNRG messenger RNA and protein was found to be predominantly restricted to the epithelial cells of terminal bronchioles. Autoantibodies to KCNRG, a protein mainly expressed in bronchial epithelium, are strongly associated with pulmonary involvement in APS-1. These findings may facilitate the recognition, diagnosis, characterization, and understanding of the pulmonary manifestations of APS-1.
|
|
| 3. |
- Arfaoui, Ghada, et al.
(författare)
-
A Security Architecture for 5G Networks
- 2018
-
Ingår i: IEEE Access. - : IEEE. - 2169-3536. ; 6:17, s. 22466-22479
-
Tidskriftsartikel (refereegranskat)abstract
- 5G networks will provide opportunities for the creation of new services, for new business models, and for new players to enter the mobile market. The networks will support efficient and cost-effective launch of a multitude of services, tailored for different vertical markets having varying service and security requirements, and involving a large number of actors. Key technology concepts are network slicing and network softwarisation, including network function virtualisation and software-defined networking. The presented security architecture builds upon concepts from the 3G and 4G security architectures but extends and enhances them to cover the new 5G environment. It comprises a toolbox for security relevant modelling of the systems, a set of security design principles, and a set of security functions and mechanisms to implement the security controls needed to achieve stated security objectives. In a smart city use case setting, we illustrate its utility; we examine the high-level security aspects stemming from the deployment of large numbers of IoT devices and network softwarisation.
|
|
| 4. |
- Arlat, Jean, et al.
(författare)
-
Fourth workshop on dependable and secure nanocomputing
- 2010
-
Ingår i: Proceedings of the International Conference on Dependable Systems and Networks; 2010 IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2010; Chicago, IL; 28 June 2010 through 1 July 2010. - 9781424475018 ; , s. 619-620
-
Konferensbidrag (refereegranskat)abstract
- Nanocomputing technologies hold the promise for higher performance, lower power consumption as well as increased functionality. However, the dependability of these unprecedentedly small scale devices remains uncertain. The main sources of concern are: • Nanometer devices are expected to be highly sensitive to process variations. The guard-bands used today for avoiding the impact of such variations will not represent a feasible solution in the future. Thus, timing errors may occur more frequently. • New failure modes, specific to new materials, are expected to raise serious challenges to the design and test engineers. • Environment induced errors, like single event upsets (SED), are likely to occur more frequently than in the case of conventional semiconductor devices. • New hardware redundancy techniques are needed to enable development of energy efficient systems. • The increased complexity of the systems based on nanotechnology will require improved computer aided design (CAD) tools, as well as better validation techniques. • Security of nanocomputing systems may be threatened by malicious attacks targeting new vulnerable areas in the hardware. © 2010 IEEE.
|
|
| 5. |
- Arlat, Jean, et al.
(författare)
-
Fourth workshop on dependable and secure nanocomputing
- 2010
-
Ingår i: Proceedings of the International Conference on Dependable Systems and Networks; 2010 International Conference on Dependable Systems and Networks Workshops, DSN-W 2010; Chicago, IL; 28 June 2010 through 1 July 2010. - 9781424477302 ; , s. 93-94
-
Konferensbidrag (refereegranskat)
|
|
| 6. |
- Arlat, Jean, et al.
(författare)
-
Third workshop on dependable and secure nanocomputing
- 2009
-
Ingår i: 2009 IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2009; Lisbon; Portugal; 29 June 2009 through 2 July 2009. - 9781424444212 ; , s. 596-597
-
Konferensbidrag (refereegranskat)
|
|
| 7. |
- Banacki, Michał, et al.
(författare)
-
Hybrid no-signaling-quantum correlations
- 2022
-
Ingår i: New Journal of Physics. - : IOP Publishing. - 1367-2630. ; 24:8
-
Tidskriftsartikel (refereegranskat)abstract
- Fundamental investigations in non-locality have shown that while the no-signaling principle alone is not sufficient to single out the set of quantum non-local correlations, local quantum mechanics and no-signaling together exactly reproduce the set of quantum correlations in the two-party Bell scenario. Here, we introduce and study an intermediate hybrid no-signaling quantum set of non-local correlations that we term HNSQ in the multi-party Bell scenario where some subsystems are locally quantum while the remaining subsystems are only constrained by the no-signaling principle. Specifically, the set HNSQ is a super-quantum set of correlations derived from no-signaling assemblages by performing quantum measurements on the trusted subsystems. We show that in contrast to the set NS of no-signaling behaviors, there exist extreme points of HNSQ in the tripartite Bell scenario that admit quantum realization. As a tool for optimization over the set HNSQ, we introduce an outer hierarchy of semi-definite programming approximations to the set following an approach put forward by Doherty–Parrilo–Spedalieri. We perform an extensive numerical analysis of the maximal violation of the facet Bell inequalities in the three-party binary input–output scenario and study the corresponding self-testing properties. In contrast to the usual no-signaling correlations, the new set allows for simple security proofs of (one-sided)-device-independent applications against super-quantum adversaries.
|
|
| 8. |
- Barathan, Muttiah, et al.
(författare)
-
CD8+T cells of chronic HCV-infected patients express multiple negative immune checkpoints following stimulation with HCV peptides
- 2017
-
Ingår i: Cellular Immunology. - : ACADEMIC PRESS INC ELSEVIER SCIENCE. - 0008-8749 .- 1090-2163. ; 313
-
Tidskriftsartikel (refereegranskat)abstract
- Hepatitis C virus (HCV)-specific CD4+ and CD8+ T cells are key to successful viral clearance in HCV disease. Accumulation of exhausted HCV-specific T cells during chronic infection results in considerable loss of protective functional immune responses. The role of T-cell exhaustion in chronic HCV disease remains poorly understood. Here, we studied the frequency of HCV peptide-stimulated T cells expressing negative immune checkpoints (PD-1, CTLA-4, TRAIL, TIM-3 and BTLA) by flow cytometry, and measured the levels of Th1/Th2/Th17 cytokines secreted by T cells by a commercial Multi-Analyte ELISArray (TM) following in vitro stimulation of T cells using HCV peptides and phytohemagglutinin (PHA). HCV peptide stimulated CD4+ and CD8+ T cells of chronic HCV (CHC) patients showed significant increase of CTLA-4. Furthermore, HCV peptide-stimulated CD4+ T cells of CHC patients also displayed relatively higher levels of PD-1 and TRAIL, whereas TIM-3 was up-regulated on HCV peptide-stimulated CD8+ T cells. Whereas the levels of IL-10 and TGF-beta 1 were significantly increased, the levels of pro-inflammatory cytokines IL-2, TNF-alpha, IL-17A and IL-6 were markedly decreased in the T cell cultures of CHC patients. Chronic HCV infection results in functional exhaustion of CD4+ and CD8+ T cells likely contributing to viral persistence. (C) 2016 Elsevier Inc. All rights reserved.
|
|
| 9. |
- Barathan, Muttiah, et al.
(författare)
-
Chronic hepatitis C virus infection triggers spontaneous differential expression of biosignatures associated with T cell exhaustion and apoptosis signaling in peripheral blood mononucleocytes
- 2015
-
Ingår i: Apoptosis (London). - : Springer Verlag (Germany). - 1360-8185 .- 1573-675X. ; 20:4, s. 466-480
-
Tidskriftsartikel (refereegranskat)abstract
- Persistent hepatitis C virus (HCV) infection appears to trigger the onset of immune exhaustion to potentially assist viral persistence in the host, eventually leading to hepatocellular carcinoma. The role of HCV on the spontaneous expression of markers suggestive of immune exhaustion and spontaneous apoptosis in immune cells of chronic HCV (CHC) disease largely remain elusive. We investigated the peripheral blood mononuclear cells of CHC patients to determine the spontaneous recruitment of cellular reactive oxygen species (cROS), immunoregulatory and exhaustion markers relative to healthy controls. Using a commercial QuantiGenePlex(A (R)) 2.0 assay, we determined the spontaneous expression profile of 80 different pro- and anti-apoptotic genes in persistent HCV disease. Onset of spontaneous apoptosis significantly correlated with the up-regulation of cROS, indoleamine 2,3-dioxygenase (IDO), cyclooxygenase-2/prostaglandin H synthase (COX-2/PGHS), Foxp3, Dtx1, Blimp1, Lag3 and Cd160. Besides, spontaneous differential surface protein expression suggestive of T cell inhibition viz., TRAIL, TIM-3, PD-1 and BTLA on CD4+ and CD8+ T cells, and CTLA-4 on CD4+ T cells was also evident. Increased up-regulation of Tnf, Tp73, Casp14, Tnfrsf11b, Bik and Birc8 was observed, whereas FasLG, Fas, Ripk2, Casp3, Dapk1, Tnfrsf21, and Cflar were moderately up-regulated in HCV-infected subjects. Our observation suggests the spontaneous onset of apoptosis signaling and T cell exhaustion in chronic HCV disease.
|
|
| 10. |
- Barathan, Muttiah, et al.
(författare)
-
Peripheral loss of CD8(+)CD161(++)TCRV7 center dot 2(+) mucosal-associated invariant T cells in chronic hepatitis C virus-infected patients
- 2016
-
Ingår i: European Journal of Clinical Investigation. - : WILEY-BLACKWELL. - 0014-2972 .- 1365-2362. ; 46:2, s. 170-180
-
Tidskriftsartikel (refereegranskat)abstract
- BackgroundMucosal-associated invariant T (MAIT) cells play an important role in innate host defence. MAIT cells appear to undergo exhaustion and are functionally weakened in chronic viral infections. However, their role in chronic hepatitis C virus (HCV) infection remains unclear. Materials and methodsWe investigated the frequency of CD8(+)CD161(++)TCR V7.2(+) MAIT cells in a cross-sectional cohort of chronic HCV-infected patients (n = 25) and healthy controls (n = 25). Peripheral blood mononuclear cells were investigated for circulating MAIT cell frequency, liver-homing (CCR5 and CD103), biomarkers of immune exhaustion (PD-1, TIM-3 and CTLA-4), chronic immune activation (CD38 and HLA-DR), and immunosenescence (CD57) by flow cytometry. ResultsThe frequency of MAIT cells was significantly decreased, and increased signs of immune exhaustion and chronic immune activation were clearly evident on MAIT cells of HCV-infected patients. Decrease of CCR5 on circulating MAIT cells is suggestive of their peripheral loss in chronic HCV-infected patients. MAIT cells also showed significantly increased levels of HLA-DR, CD38, PD-1, TIM-3 and CTLA-4, besides CD57 in chronic HCV disease. ConclusionsImmune exhaustion and senescence of CD8(+)CD161(++)TCR V7.2(+) MAIT cells could contribute to diminished innate defence attributes likely facilitating viral persistence and HCV disease progression.
|
|
