Senior Big Data Engineer & Database Administrator
About the position StackAdapt is the leading technology company that empowers marketers to reach, engage, and convert audiences with precision. With 465 billion automated optimizations per second, the AI-powered StackAdapt Marketing Platform seamlessly connects brand and performance marketing to drive measurable results across the entire customer journey. The most forward-thinking marketers choose StackAdapt to orchestrate high-impact campaigns across programmatic advertising and marketing channels. What You'll Be Doing: This role will be responsible for all operational database administration duties, data engineering, and data operations within the Data Lake and Enterprise Data Warehouse (Snowflake) ecosystem including, but not limited, to the following: Take the lead on our daily database administration, ensuring our data environment stays healthy and reliable. Partner closely with our Staff EDW Architect to bring new visions to life, designing high-quality data artifacts that follow industry best practices. Turn business needs into smart, reusable ETL solutions that grow alongside our company. Design end-to-end pipelines using your expertise with data models and architecture diagrams to build automated ingestion and transformation pipelines that keep our data moving on schedule Analyze and produce artifacts such as Source-to-Target Mapping documents. Build pipelines that bring together data from everywhere—whether it’s RDBMS, APIs, JSON, or flat files—creating a seamless flow of information. Define the "Source of Truth" using tools like Python and ETL software to clean, integrate, and transform data into a single, reliable resource the whole company can trust. Provide day-to-day operational support for all the data pipelines by monitoring and investigating alerts, while troubleshooting and remediating production issues in a timely manner. Act as a player-coach for junior and intermediate data engineers and ETL developers as the EDO team grows.
Responsibilities
- Take the lead on our daily database administration, ensuring our data environment stays healthy and reliable.
- Partner closely with our Staff EDW Architect to bring new visions to life, designing high-quality data artifacts that follow industry best practices.
- Turn business needs into smart, reusable ETL solutions that grow alongside our company.
- Design end-to-end pipelines using your expertise with data models and architecture diagrams to build automated ingestion and transformation pipelines that keep our data moving on schedule
- Analyze and produce artifacts such as Source-to-Target Mapping documents.
- Build pipelines that bring together data from everywhere—whether it’s RDBMS, APIs, JSON, or flat files—creating a seamless flow of information.
- Define the "Source of Truth" using tools like Python and ETL software to clean, integrate, and transform data into a single, reliable resource the whole company can trust.
- Provide day-to-day operational support for all the data pipelines by monitoring and investigating alerts, while troubleshooting and remediating production issues in a timely manner.
- Act as a player-coach for junior and intermediate data engineers and ETL developers as the EDO team grows.
Requirements
- Deep experience performing ETL design and development via custom coding (SQL, Python, Spark, Java, etc.) as well as using ETL tools (e.g., Coalesce, Informatica, DataStage, Talend) and other tools such as Data Quality tools, Metadata Manager, etc.
- Extensive hands-on, professional, experience working with Snowflake as a Database Administrator (DBA) and clear understanding of Snowflake’s Access Control framework
- Comfortable with Cloud-hosted solutions, especially AWS with experience deploying Secrets Manager, KMS, S3, EC2, Linux, Cross-Account Access, etc in a scaled environment
- Innate curiosity to fundamentally understand and solve problems. You’re not satisfied until you can clearly explain how and why and error occurred, and you are driven to ensure it never happens again!
- Understanding of data warehousing architecture fundamentals (e.g., Kimball vs. Inmon, Medallion Architecture, 3NF data models, reference data models, dimensional models, conformed dimensions, SCDs, etc.).
- Experience in orchestrating data operations via tools such as Apache Airflow, Cron, Astronomer etc.
Benefits
- Highly competitive salary
- Retirement/ 401K/ Pension Savings globally
- Competitive Paid time off packages including birthday's off!
- Access to a comprehensive mental health care program
- Health benefits from day one of employment
- Work from home reimbursements
- Optional global WeWork membership for those who want a change from their home office and hubs in London and Toronto
- Robust training and onboarding program
- Coverage and support of personal development initiatives (conferences, courses, books etc)
- Access to StackAdapt programmatic courses and certifications to support continuous learning
- An awesome parental leave program
- A friendly, welcoming, and supportive culture
- Our social and team events!
Apply tot his job Apply To this Job