Big Data Engineer [Spark, Python, Orchestration]
Our client, one of the largest accounting and consulting firms in the southeastern U.S., is seeking an individual who is energized by helping organizations navigate the next wave of innovation and change.This role is responsible for scheduling, orchestrating, and executing big data workflows and jobs using next-generation Data Workflow Orchestration platforms to meet needs for scale and speed. You will build fully managed workflows, enabling high throughput, horizontal scalability, and advanced parametrized, event-based scheduling.
Your team will build an ETL framework forincremental data processingfor increased data accuracy, freshness, and easy backfill to directly impact the cost and operational efficiency of Analytics and ML. You will join a collaborative, cross-functional team that values your insight, encourages you to take on new responsibilities, promotes continuous learning, and rewards innovation.We are seeking someone with knowledge of building next-gen capabilities on scalable and secure enterprise-grade platforms.You will collaborate with relevant business and technology partners across the firm and clients' multiple sectors.