# AI Engineer at Crogl

> Remote · United States · Unspecified · ML / AI · open. Source: https://alderhq.app/jobs/ashby%3Acrogl%3A86816f2a-b2b9-4067-990f-dbc24dd02216 (read 2026-11-18).

## Facts (observed)

- Company: [Crogl](https://alderhq.app/companies/crogl)
- Location text: United States
- Where it can be done from (inferred): Remote · United States (evidence: "Location: United States")
- Posted: 2026-06-30 (141 days ago)
- First seen by alder: 2026-11-04 · last verified: 2026-11-17
- Reposted: 0 times · edited: 0 times
- Apply on the employer's site: https://jobs.ashbyhq.com/crogl/86816f2a-b2b9-4067-990f-dbc24dd02216
- Skills listed (inferred): Python, LLMs, Distributed systems

## Pay and sponsorship

- Posted pay: not posted
- Market band for similar posted roles (United States, n 929): p25 $183k, median $221k, p75 $275k

## Description (the employer's text)

Crogl

Fully Autonomous AI Team Member for Your SOC

Crogl is building AI-powered systems that help security teams investigate, understand, and respond to threats faster. We combine advances in large language models, agent architectures, and security expertise to create intelligent systems that solve real-world problems for security practitioners.

We’re looking for AI Engineers who are excited about building practical AI products. You’ll help design, evaluate, and improve agentic systems that operate in production, working closely with customers, engineers, and product teams to push the boundaries of what’s possible with modern AI.

### What you’ll be doing

Build LLM-powered features, workflows, and agentic systems that solve real customer problems.

Design and implement evaluation frameworks to measure agent quality, reliability, and business impact.

Create automated benchmarks, regression tests, and datasets for evaluating AI behavior.

Investigate agent failures and develop systematic approaches to improve performance.

Experiment with prompting, tool use, retrieval, memory, planning, and reasoning strategies.

Build infrastructure that supports rapid experimentation, evaluation, deployment, and monitoring.

Work closely with customers and internal teams to understand workflows and identify opportunities for AI automation.

Contribute to engineering best practices for testing, observability, and production reliability.

Stay current with advances in LLMs, agents, evaluation methodologies, and AI engineering.

### A core part of this role: evaluating AI systems

Building agents is only half the challenge. Understanding whether they are actually improving is equally important. A significant portion of this role involves designing and maintaining evaluation systems for AI agents operating in real-world security workflows.

You’ll help answer questions like:

Is the agent producing accurate investigations?

Are changes to prompts, tools, or models actually improving outcomes?

How do we detect regressions before customers experience them?

Which failure modes matter most?

How do we measure reliability, trustworthiness, and business impact?

You’ll build benchmarks, datasets, automated evaluations, regression testing pipelines, and observability systems that help us continuously improve agent performance.

### What you’ll bring to the team

Strong programming skills, preferably in Python.

Solid software engineering fundamentals, including testing, debugging, and system design.

Experience building applications, projects, or products using LLMs and modern AI tools.

Ability to design experiments, interpret results, and make data-driven decisions.

Strong communication skills and willingness to collaborate across disciplines.

Curiosity, ownership, and a desire to learn quickly.

### What makes you stand out from others

Experience building AI agents, copilots, or workflow automation systems.

Experience designing evaluations, benchmarks, or testing frameworks for AI systems.

Familiarity with OpenAI, Anthropic, Gemini, or open-source LLM ecosystems.

Experience with retrieval systems, vector databases, and RAG architectures.

Familiarity with LangGraph, OpenAI Agents SDK, MCP, or similar agent frameworks.

Experience with observability, tracing, and production monitoring for AI systems.

Exposure to cybersecurity, security operations, or developer tooling.

Open-source contributions, research projects, or personal AI products.

### Example projects

Building evaluation suites that measure the quality of AI-driven security investigations.

Creating automated regression tests to detect model and prompt regressions.

Improving agent reasoning, planning, and tool-use capabilities.

Developing datasets and benchmarks that reflect real customer workflows.

Building systems that automatically identify and categorize agent failures.

Designing feedback loops that continuously improve production agent performance.

### Who thrives at Crogl

The strongest candidates for this role are usually builders.

You may have experience as a software engineer, ML engineer, researcher, AI engineer, or founder. What matters most is your ability to learn quickly, work independently, and ship impactful systems. We’re particularly excited about candidates who have:

---
Data: alder (https://alderhq.app). Cite https://alderhq.app/jobs/ashby%3Acrogl%3A86816f2a-b2b9-4067-990f-dbc24dd02216 and the date you read it. Observed facts come from the employer's own listing; location reach, level, family and skills are inferences.
