Skip to content
Jobgether

Software Engineer 3 - GenAI

IndiaRemote · India
Full-time · Security & IT
POSTED 13 NOVVERIFIED 11H AGO
Apply Ask
Role
6 days opentrue age
Posted 13 Nov
Pay
$24k–$158kno pay posted
$24k$158k
Market p25–p75
$26k–$129k
Jobgether p25–p75
$24k–$158kn=4
India · n=18 · 365d to 19 Nov
CompanyJobgether →
2,000open roles
Opened · 30d
+8,759
Closed · 30d
−5,427
Signal
▲ Expanding+3,332 net
18d of snapshots · 30d window
Market
37,671open · Software engineering
Opened · 7d
+3,5779% of open
All software engineering
75,155open
All tracked boards · live 20 Nov · n=37,671
PythonJavaPostgreSQLRedisAWSKubernetesDockerLLMsDistributed systems

Accountabilities:

  • Design, develop, and scale production-ready multi-agent systems, including supervisor and router architectures, specialized agents, LangGraph workflows, tool calling, conversation memory, and checkpointing.
  • Build robust and strongly typed tool contracts and data-access layers using internal APIs, ensuring that language models interpret and explain verified results rather than generate unsupported numerical information.
  • Develop and maintain Retrieval-Augmented Generation (RAG) pipelines for utility tariff information and knowledge retrieval, implementing tenant-isolated embeddings and retrieval mechanisms.
  • Optimize application performance, latency, reliability, and infrastructure costs through caching, prewarming, retries, circuit breakers, and intelligent model routing across different model tiers.
  • Implement security and AI guardrails to protect applications against prompt injection, unauthorized access, inappropriate scope usage, and tenant data leakage.
  • Ensure secure data management and privacy across multi-tenant GenAI applications.
  • Develop observability and evaluation capabilities using tools such as LangSmith to monitor model behavior, agent performance, and application reliability.
  • Collaborate with Software Development Engineers in Test (SDETs) to create evaluation datasets, regression testing suites, and quality criteria for production releases.
  • Investigate and troubleshoot production issues using traces, logs, and performance metrics, identifying root causes and implementing long-term solutions.
  • Support real-time streaming capabilities through WebSocket and Server-Sent Events (SSE), collaborating with frontend teams on seamless widget and application integration.
  • Lead technical design discussions, architecture reviews, and code reviews while establishing engineering standards and development best practices.
  • Mentor and support junior engineers, particularly SDE1 and SDE2 developers, helping them improve their technical skills and engineering capabilities.
  • Communicate technical designs, architectural decisions, implementation trade-offs, and project progress effectively to engineering teams, product stakeholders, and leadership.
  • Work closely with GenAI engineering, platform, QA/SDET, and product teams to deliver reliable, user-focused AI solutions.

Requirements

  • 6–10 years of professional software engineering experience, including at least 1–2 years of hands-on experience building and deploying production-grade LLM or Generative AI features.
  • Strong programming proficiency in Python and good working knowledge of Java.
  • Practical experience with agent orchestration frameworks such as LangChain, LangGraph, or equivalent technologies.
  • Hands-on experience integrating Large Language Model APIs, including OpenAI, Anthropic, or Amazon Bedrock.
  • Strong understanding of prompt engineering, tool/function calling, structured outputs, and LLM application development.
  • Experience designing and implementing Retrieval-Augmented Generation (RAG) systems using embeddings and vector databases or stores, such as pgvector.
  • Strong backend engineering and API design capabilities, with experience building scalable, high-performance, and low-latency services.
  • Practical experience with AWS cloud infrastructure, containers, Kubernetes/EKS, PostgreSQL, Redis, and CI/CD pipelines.
  • Familiarity with LLM evaluation techniques, LLM-as-a-judge approaches, and AI observability platforms such as LangSmith.
  • Strong knowledge of system architecture, distributed systems, scalability, and performance optimization.
  • Understanding of production monitoring, debugging, reliability engineering, and automated testing practices.
  • Excellent analytical and problem-solving abilities, with the capacity to address complex technical challenges.
  • Strong communication and collaboration skills, with experience participating in technical discussions and explaining architectural decisions to diverse stakeholders.
  • Previous experience leading code reviews, contributing to engineering standards, and mentoring junior developers.

How Jobgether works

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

Source · JobgetherFirst seen 13 NovOriginal ↗