Global Head, Neuroscience Translational Medicine
Novartis AG
Date de publication :
10 septembre 2024Taux d'activité :
100%- Lieu de travail :Basel (City)
<div class="ibm-col-12-8"><!-- COPY next 3 lines into application form --><p class="ibm-bold ibm-padding-top-r1">Master Thesis, Semester project or Internship</p><h2 class="ibm-h3 ibm-light">Large Vision-Language Models for Enterprise Visual Inspection</h2><p class="ibm-padding-bottom-r1">Ref. 2024_017</p><div class="ibm-container-body"><p class="ibm-bold">Project description</p><p>Are you looking for an opportunity to be part of an innovative computer vision project, where you can challenge your knowledge and skills on real enterprise applications and data? You are looking at the right place! Our team is developing a radically new way to build computer vision models based on <a href="https://research.ibm.com/projects/visual-prompting">interactive visual prompting.</a></p><p>In less than a year, we created a new pipeline and beated every other SOTA approach, including the most recent few-shot learning benchmarks. Our pipeline makes use of some of the most popular <b>Large Vision Models</b>, such as <a href="https://ai.meta.com/sam2/">SAM/SAM2</a> and <a href="https://dinov2.metademolab.com/">DINOv2</a>, in a novel and unique way. We have implemented it into our new service – Visual Prompting Lab – that has been already successfully used on enterprise applications, including discrete manufacturing, quality inspection, and asset inspection (particularly in civil infrastructure). </p><p>We now have plenty of ideas on how to bring this work to the next level, by utilizing Vision-Language Models, Agentic AI and other recent AI developments. More in detail, we can offer research and innovation projects on topic such as:</p><ul><li>Interactive Prompting </li><li>Large Vision-Language Models</li><li>Anomaly Detection</li><li>Pre-training/Fine-Tuning of Large Vision Models (aka Vision Foundation Models)</li><li>Agentic AI</li><li>Generative AI</li></ul><p>A unique aspect of all our projects, is the opportunity to work on client data that are not available to the public and represent a big challenge even for the most successful state-of-the-art methods. As part of our team, you will collaborate with experienced Research Scientists and AI Software Engineers that will lead and help you to successfully complete the challenges of the proposed task. You will also have access to modern GPUs and Cloud infrastructures. The technology created in our team is powering IBM mainstream products, such as <a href="https://developer.ibm.com/components/maximo-visual-inspection">Maximo Visual Inspection</a> and soon <a href="https://www.ibm.com/watsonx">watsonx.</a> We will also encourage you to do your fist patent with us and to publish your work on a Top AI conference. </p><p>This opportunity is particularly designed for students from ETH Zurich, as our IBM Research Laboratory is located just 40 minutes away from there. We welcome candidacies of students from EPFL, USI and other prestigious universities, also from abroad when the students have the possiblity to finance their stay in Zurich for the duration of the project – which is generally 6 months.</p><p class="ibm-bold">Minimum qualifications</p><ul><li>Bachelor’s degree in computer science, machine learning or a related technical field, including equivalent practical experience</li><li>Excellent coding skills</li><li>Proficient working in Unix/Linux environments </li><li>Excellent communication and presentation skills in English</li><li>Team player, self-motivated, able to solve problems autonomously</li></ul><p class="ibm-bold">Preferred qualifications</p><ul><li>Experience with one or more of the following: computer vision, natural language processing, algorithms and data structures, test automation, distributed computing, CI/CD</li><li>Practical experience with PyTorch</li><li>Advanced programming experience, such as C/C++ programming experience</li><li>Independent worker with the ability to effectively operate with flexibility in a fast-paced, constantly evolving team environment</li></ul><p class="ibm-bold">Diversity</p><p>IBM is committed to <a class="ibm-inlinelink ibm-forward-link" href="https://www.ibm.com/impact/be-equal/" target="_blank">diversity</a> at the workplace. With us you will find an open, multicultural environment. Excellent flexible working arrangements enable all genders to strike the desired balance between their professional development and their personal lives.<br/><br/></p><p class="ibm-bold">How to apply</p><p>If you are interested in this exciting position, please submit your most recent curriculum vitae. We encourage candidates to also share a 3-minute video, in which they introduce themselves, as well as highlight their motivation and expertise. The video is not mandatory.</p><a href="/careers/2024_017_apply.html" target="_blank"></a><p> </p><p class="ibm-bold">Interview process</p><p>After the initial screening based on the uploaded documentation, identified candidates will be contacted for a first technical discussion on their experience, background, and motivations, followed by a coding interview and a project matching discussion.</p><p> </p><!-- <p>If you have any question related to this position, please contact Dr. Darius Urbonas, <a class="ibm-inlinelink ibm-email-link" href="E-Mail schreiben">E-Mail schreiben</a> and Dr. Rainer F. Mahrt, <a class="ibm-inlinelink ibm-email-link" href="E-Mail schreiben">E-Mail schreiben</a>.</p> <p></p> <p><strong>References</strong><br>[1] Miller, D. A. B. Are optical transistors the logical next step? <em>Nature Photon</em> <strong>4</strong>, 3–5 (2010)<br>[2] Zasedatelev, A. V. <em>et al.</em> A room-temperature organic polariton transistor. <em>Nat. Photonics</em> <strong>13</strong>, 378–383 (2019)<br>[3] Zasedatelev, A. V. <em>et al.</em> Single-photon nonlinearity at room temperature. <em>Nature</em> <strong>597</strong>, 493–497 (2021)<br>[4] Tassan, P. <em>et al.</em> Integrated ultrafast all-optical polariton transistors. Preprint at <a href="http://arxiv.org/abs/2404.01868" target="_blank">arXiv:2404.01868</a> (2024)<br></p></div></div><!-- -------- Use this side column for images ---------------- <div class="ibm-col-12-3"><p> </p> <p class="ibm-padding-top-r1"><img class="ibm-downsize" src="/images/careers/2022-054.jpg" alt="Two researchers" /></p> <p> </p> <p class="ibm-padding-top-r1"><img class="ibm-downsize" src="/images/careers/2022-054.png" alt="Image" /></p></div> --></div></div>
Contact
Novartis AG