Performance Modeling Engineer
Posted Updated
Description
- Develop comprehensive performance models and projections for Sohu’s transformer-specific architecture across varying workloads and configurations
- Profile and analyze deep learning workloads on Sohu to identify micro-architectural bottlenecks and influence optimization opportunities
- Drive hardware/software co-optimization by identifying where architectural features can unlock performance improvements
- Run regressions and validate performance models against real systems and silicon
- Inform next-generation architectural decisions by pathfinding across system and silicon options during design, proof-of-concept, and architecting phases
Benefits
- Competitive Salary and Equity - We offer a competitive salary and equity package that aligns with industry standards
- Benefits - Your wellbeing is important to us. We offer unlimited PTO, life insurance, and a 401(k)
- Full Insurance Coverage - Our insurance includes full medical, dental, and vision with 100% of premium covered
- Solid software engineering fundamentals with an eye toward auditability and maintainability
- Experience profiling and analyzing deep learning workloads on hardware accelerators (GPUs, TPUs, ASICs, FPGAs, or others)
- Strong performance modeling and analysis skills with experience building analytical-based or simulation-based performance models
- Solid understanding of computer architecture and micro-architecture, particularly for accelerators
- Published research in computer architecture, ML systems, or hardware acceleration
- Familiarity with transformer model architectures and inference serving optimizations
- Experience with architecture simulators and performance modeling tools (gem5, trace-driven simulators, custom models)
- Deep knowledge of GPU architectures and/or programming models like CUDA
- Exposure to ASIC, FPGA, or CGRA-based accelerator development and hardware/software co-design principles
- Experience mapping models to multi-chip inference systems
Skills
Sign in to read and join the discussion.