PhD Position in Decentralized Resource-Constrained Machine Learning

The Distributed Computing (DISCO) Group is a research group at ETH Zurich, led by Prof. Dr. Roger Wattenhofer. We are interested in a variety of research topics on new and upcoming areas off the beaten paths. Our three main areas of research are machine learning, distributed systems, and theory of networks. Within these three areas, we are currently working on several projects: graph neural networks, natural language processing, algorithmic learning, fault-tolerance, blockchains, consensus, cryptocurrencies, digital money, central bank digital currency, decentralized finance, financial networks, e-democracy, voting, social networks, online analysis with delay, and theory of distributed algorithms. In our group, we work on both theory and practice: some members of our group focus on algorithms and mathematical proofs, and some on system design and building.

The Distributed Computing group at ETH Zurich is looking for a PhD candidate to work on the SNSF Ambizione 2023 project “eDIAMOND: Efficient Distributed Intelligent Applications in Mobile-Network Dynamics”, starting on 1 September 2025. The eDIAMOND project aims at developing new methods and systems for decentralized and distributed data-driven methods for Federated Learning on resource-constrained networks. Your research within the project will contribute towards your doctoral degree at ETH Zurich. You will be supervised by Prof. Dr. Roger Wattenhofer and Dr. Antonio Di Maio.

You will be entrusted with designing, developing, and evaluating data-driven methods, algorithms, and systems for three independent but related research directions in the eDIAMOND project, namely:

1. Distributing model training and inference over a network of resource-constrained devices.
2. Online, context-aware adaptation of Federated Neural Network Architectures based on the available system resources (e.g., communication, computation, energy).
3. Communication-efficient knowledge exchange among networked federated large models.

These research directions allow you to gradually build your own research profile according to your interests, while remaining within the project’s goals. Each research direction is composed of a sequence of Tasks that will collectively achieve the project’s goal. For each Task, you will be responsible for the typical scientific research workflow: motivating the problem, identifying the main methodological shortcomings in the literature, design and develop novel systems, plan and execute experiments, and report findings in articles to be published at top venues according to the project’s schedule. Periodic meetings and feedback will ensure the success of your degree and of the project overall.

Other info

• Updated Information
• Details on Terms of Employment
• The PhD Survival Guide from ETH Zurich
• All about the doctorate at ETH Zurich

We are looking for a new member with the following profile:

1. A strong interest and motivation to contribute to the eDIAMOND project’s goals (see Job description section above).
2. Theoretical and practical experience and passion in at least one of the following topics:

• Machine Learning: Deep Learning, Federated Learning (vertical, horizontal), Split Learning, Model Selection, Knowledge Distillation, Low-Rank Adaptation (LoRA), Large Models (Language, Vision).
• Decentralized and Distributed Systems: Gossip Protocols, Consensus Algorithms, (Byzantine) Fault Tolerance, Peer-to-Peer Networks.
• Online Algorithms: Partially-Observable Markov Decision Processes (POMDPs), Cooperative and Competitive Multi-Agent Reinforcement Learning (MARL), Multi-armed Bandits, Bayesian Optimization.
• Automated Model Design and Tuning: Neural Architecture Search, Hyperparameter Optimization.
• Computer Networking: Resource-Constrained Networking (e.g., Internet of Things), Wireless and Mobile Communications (e.g. IEEE 802.11, Bluetooth, etc.), Protocols (e.g., MAC, Network, and Transport).
• Mathematics: Statistical Learning, Stochastic Processes (e.g., Percolation Theory, Queuing Theory, Age of Information), Network Calculus, Graph Theory, Convex and Non-convex Optimization, Approximation Algorithms.

1. An excellent Master’s degree in Computer Science, Engineering, Mathematics, or other fields related to the project’s domain, from a reputable university, to be obtained before 1 September 2025 (depending on visa requirements).
2. A strong Transcript of Records, stating the list of passed exams (particularly those related to the project and the areas above) and their grades.
3. Strong programming skills (i.e., Python and main Machine Learning frameworks such as Pytorch).
4. Experience with scientific writing (e.g., reports, theses, and scientific articles).
5. Strong critical thinking, English communication skills (oral and written), interpersonal abilities, collaboration aptitude.

Bonus points:

• Published peer-reviewed articles on project-related topics in reputable conferences or journals
• Experience with network simulators such as OMNeT++ or ns-3
• Experience with High Performance Computing (i.e., SLURM)
• Experience with Git

• Your career with impact: Become part of ETH Zurich, which not only supports your professional development, but also actively contributes to positive change in society.
• We are actively committed to a sustainable and climate-neutral university.
• You can expect numerous benefits, such as public transport season tickets and car sharing, a wide range of sports offered by the ASVZ, childcare and attractive pension benefits.