Software Engineer

Job Description

Responsibilities

• Participate in a structured training track to develop expertise in AI benchmarking, profiling, and performance tuning.
• Build and scale benchmarking infrastructure for evaluating AI systems in enterprise settings.
• Design agent evaluation pipelines that measure reasoning, accuracy, alignment, and user outcomes.
• Participate in a structured AI benchmarking training track, gaining expertise in profiling, telemetry, and performance tuning.
• Collaborate with AI and Infra teams to instrument model-serving systems (vLLM, Triton, Ray, or Kubernetes-based deployments).
• Develop data and telemetry pipelines that capture model performance, latency, and quality.
• Contribute to open benchmarking frameworks, defining how intelligent SaaS software is measured globally.
• Work with cross-functional teams to ensure benchmarks reflect real-world customer value and system impact.

What you’ll bring

• 3–10+ years of experience as a Software Engineer in backend, systems, or infrastructure roles.
• Strong foundation in Python or similar backend languages — Go, Java, C#, or Node.js.
• Hands-on experience in building APIs and cloud-native architectures (AWS, GCP, or Azure; Kubernetes a plus).
• Understanding of metrics, profiling, or observability tools (Grafana, Prometheus, ELK, or similar).
• Curiosity and commitment to learn AI benchmarking, LLM evaluation, and performance frameworks.
• Strong analytical and product intuition — you care about what the benchmark represents, not just what it measures.
• Bonus: exposure to vector search, model tuning (LoRA, DPO), or open-source contributions

Are you interested in this position?
Apply by clicking on the “Apply Now” button below!
#GraphicDesignJobsOnline
#WebDesignRemoteJobs
#FreelanceGraphicDesigner
#WorkFromHomeDesignJobs
#OnlineWebDesignWork
#RemoteDesignOpportunities
#HireGraphicDesigners
#DigitalDesignCareers
# Dynamicbrand guru