Neural Network Specification Learning
2019)
[Geng et al. 2023] Chuqin Geng et al. - "Towards Reliable Neural Specifications" (ICML 2023) Principales activités This investigation will focus on innovation and generalization across three key aspects:
1) Neural Predicate Design: Previous studies primarily considered neuron-level abstractions using basic binary predicates (active or inactive), essentially unary relations capturing only single-neuron states. Such unary predicates have limited expressiveness, as they cannot adequately represent dependencies or hierarchical structures involving multiple neurons. To overcome this limitation, we will first investigate predicates with higher arities-binary or ternary relations-that allow explicit representation of interactions and hierarchical relationships among neurons. For transformer-based architectures, neuron-level predicates are likely insufficient due to scalability challenges. To address this scalability issue, we will investigate higher-level abstractions tailored explicitly for transformers by introducing neural predicates defined over attention heads.
2) Specification Structure: The structure of neural network specifications significantly influences their generalization capability, effectiveness, and scalability. Current specification structures, such as those employed in VNN-COMP ( consist of a reference input paired with a small bound quantifying allowable perturbations. This design is inherently limited, as it specifies only a narrow region around a single input and fails to
generalize effectively even to closely related training inputs. In [Geng et al. 2023], a novel specification structure was introduced, comprising pairs of neural predicate sets - one set indicating neurons that must remain active and another indicating neurons that must remain inactive. This innovative approach successfully enabled, for the first time, comprehensive verification of neural networks across the entire input space of the MNIST handwritten digits. Building upon this success, we will generalize the specification structure further by re-designing it into a set of Horn clauses formulated over neural predicates. Utilizing Horn clauses in combination with richer neural predicates will yield a highly expressive and formally grounded language capable of representing a significantly broader and more flexible range of neural network specifications compared to existing methods.
3) Specification Learning Algorithms: The design of learning algorithms is significantly influenced by both neural predicates and specification structures. We will initially explore a general statistical approach that remains largely agnostic to specific neural predicates or specification structures. The core idea involves collecting inference traces from a dataset (either the original training set or an independent validation set), computing statistical distributions for each neural predicate, and subsequently composing candidate specifications based on these statistics. The complexity of potential neural predicates depends on factors including neuron count, abstract domain size, predicate relation types, and their arities. To ensure that the neural predicate space remains practically manageable (approximately linear with respect to neuron count), we will carefully consider network architecture and introduce pragmatic assumptions, such as locality constraints. Specifically, predicates with higher arities like binary or ternary relations will be restricted to neurons within the same convolution window, the same layer, or neighboring layers. The subsequent step - composition of specifications - is inherently challenging, as it fundamentally involves rule synthesis. Prior work [Geng et al. 2023] partially addressed this challenge through a simple yet effective approach: selecting an appropriate threshold and then conjunctively combining neural predicates that exceed this threshold. Initially, we will adopt this effective strategy to develop a functional prototype. Later, the methodology will perform systematic refinement and reduce redundancy in learned specifications, incorporating insights from formal methods, programming languages, and machine learning disciplines. Avantages
- Subsidized meals
- Partial reimbursement of public transport costs
- Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave (sick children, moving home, etc.)
- Possibility of teleworking (after 6 months of employment) and flexible organization of working hours
- Professional equipment available (videoconferencing, loan of computer equipment, etc.)
- Social, cultural and sports events and activities
- Access to vocational training
- Social security coverage
Emplois Recommandés
Gestionnaire Approvisionnement (H/F)
Présentation de l'entreprise Créée à Paris en 2011, Jimmy Fairly est une marque française qui propose des lunettes (optique & solaire) de qualité et dans l’air du temps à un prix juste en maitrisa…
Stage Vente - Conseil F/H F/H
Rattaché(e) au Responsable de département commercial, vous êtes un véritable ambassadeur de la relation client. Vous dynamisez par vos ventes, les résultats du rayon auquel vous serez affecté(e). Acc…
Auditeur sénior H/F
Description du poste Vous interviendrez sur les missions suivantes : La planification des missions d'audit ; La réalisation des missions avec l'encadrement de 1 à 3 auditeurs juniors selon l…
CHEF DE CUISINE (F/H) PARIS 08
Poste ouvert aux personnes en situation de handicap.Notre client situé à PARIS 08 recherche un talent pour rejoindre son équipe dynamique de restauration offrant des expériences culinaires de qualité.…
Aide-soignant DE H/F
Aide-soignant DE H/F 202534BVLT Vous souhaitez rejoindre une équipe dynamique et contribuer à l'amélioration de la qualité de vie des patients en HAD ? Nous recherchons activement une aide-soignante m…
Un-e animateur-rice vélo (H/F)
Études & Chantiers Ile-de-France est une association, structure d'insertion, qui promeut une écologie sociale et oeuvre en faveur d'une transformation sociétale grâce à une approche à 360 : Créer de…
Internship in Store Planning and Construction
Guerlain is offering a six-month internship in Store Planning and Construction, beginning in January 2026. The role involves supporting the development and implementation of cost optimization tools, m…
Responsable Rémunération et Etudes RH H/F
Nous recherchons pour notre client, institution parisienne majeure, un(e) Responsable Rémunération et Etudes RH H/F (Intérim de 10 mois - remplacement congé maternité) Rattaché(e) au pôle pilotage et…
Infirmier DE H/F
Infirmier DE H/F 2025-349 Centre Médical des Cévennes : Hôpital de jour non sectorisé situé à Paris 15, proposant un soin dans la durée, une alternative à l'hospitalisation temps plein, en s'appuyant …
Sales Specialist SAP
Mission Vous connaissez l'écosystème SAP sur le bout des doigts. Vous avez l'habitude de négocier avec des directions générales, IT ou métiers. Vous avez un réseau solide, …