VERIFIED ENGLISH WORKPLACE

Senior Data Engineer

Nir-Yu • US, CA, MX, AR, BR, CL, CO, PE, VE, EC, GT, HN, NI, PA, PY, UY, BO, CR, SV, DO, HT, JM, PR, TT, AD, AL, AM, AT, AZ, BY, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GE, GR, HR, HU, IE, IL, IS, IT, KZ, KG, LT, LU, LV, MD, ME, MK, MT, NL, NO, PL, PT, RO, RS, RU, SE, SI, SK, TR, UA, UZ

100% English First

Apply Directly to Employer → Calculate Net Pay After Tax

The Role:

We’re looking for a senior data engineer to own our data platform from architecture through production, reliably turning high volumes of data from provider APIs, webhooks, files, and web scraping into trusted records for our products.

Today, our enrichment and extraction workflows largely run serially inside a container. You’ll lead the move to a platform that supports concurrent processing, event-driven intake, and orchestrated batch workflows.

Responsibilities:

Multi-source intake: Build concurrent ingestion for provider APIs, webhooks, files, and scraping, with rate limits and failure handling.
Batch and event-driven execution: Orchestrate scheduled workflows and historical backfills using tools such as Airflow, Dagster, or Prefect. Build event-driven intake with Pub/Sub or Cloud Tasks, including retries, dead-letter queues, and controlled replay of failed