AI Infrastructure Engineer, Agents (San Francisco) Job at The Rundown AI, Inc., San Francisco, CA

NEw3QW8wdVZjV2pBcnFiOGVUK1FTQ2Rna2c9PQ==
  • The Rundown AI, Inc.
  • San Francisco, CA

Job Description

As a Software Engineer on the ML Infrastructure team, you will design and build the platform for our agent sandboxing platform: the secure, high-performance code execution layer powering our agentic workflows. This system underpins critical applications and research initiatives, and is deployed across both internal and customer-managed environments.

This position requires deep expertise in systems engineering: operating systems, virtualization, networking, containers, and performance optimization. Your work will directly enable agents to execute untrusted or user-submitted code safely, efficiently, and repeatedly, and with fast startup times, strong isolation guarantees, and support for snapshotting and inspection.

You will:

  • Design and build the sandboxing platform for code execution across containerized and virtualized environments.
  • Ensure strong isolation, security, and reproducibility of execution across user sessions and workloads.
  • Optimize for cold-start latency, memory footprint, and resource utilization at scale.
  • Collaborate across security, infra, and product teams to support both internal research use cases and enterprise customer deployments.
  • Lead architecture reviews and own projects from design through deployment in fast-paced, cross-functional settings.

Ideally you'd have:

  • 3+ years of experience building high-performance systems software (e.g. OS, container runtime, VMM, networking stack).
  • Deep understanding of Linux internals, process isolation, memory management, cgroups, namespaces, etc.
  • Experience with containerization and virtualization technologies (e.g., Docker, Firecracker, gVisor, QEMU, Kata Containers).
  • Proficiency in a systems programming language such as Go, Rust, or C/C++.
  • Familiarity with networking, security hardening, sandboxing techniques, and kernel-level performance tuning.
  • Comfort working across infrastructure layers, from kernel modules to orchestration frameworks (e.g., Kubernetes).
  • Strong debugging skills and the ability to make performance/security tradeoffs in production systems.

Nice to haves:

  • Familiarity with LLM agents and agent frameworks (e.g., OpenHands, Agent2Agent, MCP).
  • Experience running secure workloads in multi-tenant or untrusted environments (e.g., FaaS, CI sandboxes, remote notebooks).
  • Exposure to snapshotting and restore techniques (e.g., CRIU, VM snapshots, overlayfs).
#J-18808-Ljbffr

Job Tags

Full time,

Similar Jobs

Medical Solutions Allied

Travel Interventional Radiology Technologist Job at Medical Solutions Allied

 ...Travel \n Licensure and Certification Reimbursement \n Free Liability Coverage \n Voluntary Benefits: Critical Illness, Hospital Indemnity, Accident, and Pet Insurance \n Equal Employment Opportunity \n And More!\n \n\n Estimated pay package based on... 

Royal Oak Health Group

Invasive Cardiologist Needed 90 Miles from Dallas, TX Job at Royal Oak Health Group

 ...sized team of cardiologists that includes 9 Advance Practice Providers; and work in a practice that is supported by the Epic electronic medical record system. Practice at the region's preferred provider for heart care. Weekend call is 1:5. Typical week Monday-Thursday 1-2... 

Soliant

Unit-Based Clinical Pharmacist ED & Critical Care Focus - State College, PA Job at Soliant

 ...Were partnering with a leading healthcare organization in State College, Pennsylvania to fill a full-time, permanent Clinical...  ...interdisciplinary rounds Respond to urgent patient scenarios per hospital protocols Benefits: Relocation assistance available... 

TEKsystems

Inside Sales Representative Job at TEKsystems

 ...and existing customers via telephone, fax and email. \tEnter sales orders and quotes into P21 (internal CMS).*\tProvide...  ...Plan Pre-tax and Roth post-tax contributions available Life Insurance (Voluntary Life & AD&D for the employee and dependents) Short... 

Society of Hospital Medicine

Physician / Hospitalist / New York / Locum tenens / Physician / Hospitalist Job at Society of Hospital Medicine

 ...A Hospitalist Medicine locum tenens opportunity is available at a 110-bed acute care hospital in upstate New York. They are seeking seasonal coverage during December and January, where the provider will be seeing 15 patients per shift. ICU coverage is required where the...