Deep Learning Software Engineer Intern, Ai - Fall 2023

NVIDIA's Deep Learning Libraries Team is looking for excellent interns to enable the next wave of NVIDIA’s highest performing deep learning libraries, such as cuDNN, cuBLAS and TensorRT. The mission is to design and develop scalable and modular software products that enable breakthroughs in problems from image classification to speech recognition to natural language processing and artificial intelligence. Join the team that is building the underlying software used across the world to power the revolution in artificial intelligence! We’re always striving for peak GPU efficiency on current and future-generation GPUs. To get a sense of the code we write, check out our CUTLASS open-source project showcasing performant matrix multiply on NVIDIA’s Tensor Cores with CUDA. This specific position primarily deals with code lower in the deep learning software stack, right down to the GPU HW.

What You'll Be Doing

In this role, you will be responsible for developing and delivering highly optimized deep learning products. The scope of these efforts ranges from defining the public APIs to performance tuning and analysis, from building developer infrastructure to testing automation, from joining architecture discussion to learning latest and greatest technologies from the research community. During your internship, you will be doing one or multiple of activities below:

• Maintain and test environments for new hardware, new OSes, and platforms by using industry-standard tools (e.g. Kubernetes, Jenkins, Docker, CMake, Gitlab, Jira, etc)
• Collaborating with teams across NVIDIA:
• Participate in a high-energy and dynamic company culture to develop state of the art software and hardware products and practice hardware-software co-design
• Hardware and architecture teams on the programming model for new deep learning hardware features
• Building scalable automation for build, test, integration, and release processes for publicly distributed deep learning libraries
• Writing highly tuned compute kernels, mostly in C++ CUDA, to perform core deep learning operations (e.g. matrix multiplies, convolutions, normalizations)
• Deep learning training and inference performance teams on which layers require optimization
• Develop robust and scalable GPU-accelerated deep learning libraries, using C++ and object oriented design
• CUDA compiler team on generating optimal assembly code

What We Need To See

• Or experience in SCM (e.g. Git, Perforce) and build systems (e.g. Make, CMake, Bazel)
• Experience with performance-oriented parallel programming, even if it’s not on GPUs (e.g. with OpenMP or pthreads)
• Passion for “it just works” automation and enabling team members
• Demonstrated strong C++ programming and software design skills, including debugging, problem solving, performance analysis, and test design
• Pursuing a BS, MS or PhD in Computer Science, Compute Engineering or similar

Ways To Stand Out From The Crowd

• Numerical methods and linear algebra
• LLVM, TVM tensor expressions, or TensorFlow MLIR
• Experience in optimizing/tuning BLAS or deep learning library kernel code
• Knolwedge of CUDA/OpenCL GPU programming
• Experience with code coverage and static code analysis tools

This is an opportunity to have a wide impact at NVIDIA by improving development velocity across our many compute software projects. Are you creative, driven, and autonomous? Do you love a challenge? If so, we want to hear from you.

The hourly rate for our interns is $19 - $93. Our internship hourly rates are a standard pay determined based on the position and your location, year in school, degree, and experience.

You will also be eligible for Intern benefits .

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.#deeplearning