Staff Software Engineer, Realtime Compute

Job Description

Tecton’s Realtime Compute team builds streaming infrastructure that provides sub-second data freshness for AI applications in production. In addition to streaming, we offer a production-ready Python runtime that securely runs user code in realtime at scale. This runtime can handle tasks like generating embeddings or calling third-party APIs for information retrieval.

This position is open to candidates based anywhere in the United States. You can work in one of our hub offices in San Francisco, New York City, Seattle or work fully remotely from outside those areas within the US.


Responsibilities
  • Develop advanced streaming capabilities in Rift like joins, stateful operations and native connectors to streaming data sources
  • Build an integrated observability solution that provides an exceptional operational experience with logs, metrics, and traces
  • Scale our ingestion platform to handle millions of requests per second with low latency and high availability
  • Reduce the cold start times of our sandboxed Python execution environment for extremely fast autoscaling
  • Launch our infrastructure across multiple cloud platforms, ensuring compliance with security protocols and data residency requirements
  • Assess and prioritize tasks, demonstrating a keen awareness of performance-critical areas

  • Qualifications
  • 7+ years of experience in programming, debugging, and performance tuning distributed and/or highly concurrent software systems.
  • Degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience, with strong proficiency in building high throughput infrastructure.
  • Experience with Streaming infrastructure like Flink, Spark, Pulsar, Heron
  • Experience with Python runtimes, dependency resolution, and container sandboxing.
  • Experience with at least one of AWS, GCP.
  • Experience with low latency online storage like DynamoDB, Redis, and BigTable.