Lead Data Engineer, Data Reliability

Job ID 10103077 Location Santa Monica, California, United States / Bristol, Connecticut, United States / San Francisco, California, United States / New York, New York, United States / Seattle, Washington, United States Business Disney Entertainment & ESPN Technology Date posted Nov. 19, 2024

Apply Now

Job Summary:

Disney Entertainment & ESPN Technology

On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you’d love working for Disney Entertainment & ESPN Technology

Building the future of Disney’s media business: DE&E Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution businesses for years to come.
Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.
Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

The Data Reliability Engineering team for Disney’s Product and Data Engineering team is responsible for maintaining and improving the reliability of Disney Entertainment’s big data platform, which processes hundreds of terabytes of data and billions of events daily.

About The Role

The Lead Data Engineer will help us in the ongoing mission of delivering outstanding services to our users allowing Disney Entertainment to be more data-driven. You will work closely with our partner teams to monitor and drive improvements for reliability and observability of their critical data pipelines and deliverables. This is a high-impact role where your work informs decisions affecting millions of consumers, with a direct tie to The Walt Disney Company’s revenue. You will be making an outsized impact in an organization that values data as its top priority. We are a tight and driven team with big goals, so we seek people who are passionate about solving the toughest challenges and working at scale, using, supporting, and building distributed systems in a fast-paced collaborative team environment. We also support a healthy work-life-balance.

Responsibilities

Assist in designing and developing a platform to support incident observability and automation. This team will be required to build high quality data models and products that monitor and reports on data pipeline health and data quality.
Lead project work efforts internally and externally setting project deliverables, review design documents, perform code reviews and help mentor junior members of the team.
Collaborate with engineering teams to improve, maintain, performance tune, and respond to incidents on our big data pipeline infrastructure.
Own building out key components for observability and intelligent monitoring of data pipelines and infrastructure to achieve early and automated anomaly detection and alerting. Present your research and insights to all levels of the company, clearly and concisely.
Build solutions to continually improve our software release and change management process using industry best practices to help DSS maintain legal compliance.

Basic Qualifications

7+ years of experience working on mission critical data pipelines and ETL systems.
7+ years of hands-on experience with big data technology, systems and tools such as AWS, Hadoop, Hive, and Snowflake
Detailed problem-solving approach, coupled with a strong sense of ownership and drive
A passionate bias to action and passion for delivering high-quality data solutions
Expertise with common Data Engineering languages such as Python, Scala, Java, SQL and a proven ability to learn new programming languages
Experience with workflow orchestration tools such as Airflow
Deep understanding of end-to-end pipeline design and implementation.
Attention to detail and quality with excellent problem solving and interpersonal skills

Preferred Qualifications

Advanced degrees are a plus.
Strong data visualizations skills to convey information and results clearly
Ability to work independently and drive your own projects.
Exceptional interpersonal and communication skills.
Impactful presentation skills in front of a large and diverse audience.
Experience with DevOps tools such as Docker, Kubernetes, Jenkins, etc.
Innate curiosity about consumer behavior and technology
Experience with event messaging frameworks like Apache Kafka
A fan of movies and television is a strong plus.

Required Education

Bachelor’s degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience

Additional Information

#DISNEYTECH

The hiring range for this position in Santa Monica, California is $152,200 to $204,100 per year, in Bristol, Connecticut is $152,200 to $204,100 per year, in Seattle, Washington is $159,500 to $213,900 per year. in New York City, NY is $159,500 to $213,900 per year, and in San Francisco, California is $166,800 to $223,600 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

Apply Now

About Disney Entertainment & ESPN Technology:

Disney Entertainment and ESPN Technology (DE&E Technology) provides the technological backbone and product development for Disney’s two media business units, while helping to keep the company at the vanguard of innovation – enabling the Company to continuously leverage technology to enhance storytelling and creativity, while delivering scalability, flexibility, and efficiency for its businesses.

About The Walt Disney Company:

The Walt Disney Company, together with its subsidiaries and affiliates, is a leading diversified international family entertainment and media enterprise that includes three core business segments: Disney Entertainment, ESPN, and Disney Experiences. From humble beginnings as a cartoon studio in the 1920s to its preeminent name in the entertainment industry today, Disney proudly continues its legacy of creating world-class stories and experiences for every member of the family. Disney’s stories, characters and experiences reach consumers and guests from every corner of the globe. With operations in more than 40 countries, our employees and cast members work together to create entertainment experiences that are both universally and locally cherished.

This position is with Disney Streaming Technology LLC, which is part of a business we call Disney Entertainment & ESPN Technology.

Disney Streaming Technology LLC is an equal opportunity employer. Applicants will receive consideration for employment without regard to race, religion, color, sex, sexual orientation, gender, gender identity, gender expression, national origin, ancestry, age, marital status, military or veteran status, medical condition, genetic information or disability, or any other basis prohibited by federal, state or local law. Disney champions a business environment where ideas and decisions from all people help us grow, innovate, create the best stories and be relevant in a constantly evolving world.

DISABILITY ACCOMMODATION FOR EMPLOYMENT APPLICATIONS

The Walt Disney Company and its Affiliated Companies are Equal Employment Opportunity employers and welcome all job seekers including individuals with disabilities and veterans with disabilities. If you have a disability and believe you need a reasonable accommodation in order to search for a job opening or apply for a position, email Candidate.Accommodations@Disney.com with your request. This email address is not for general employment inquiries or correspondence. We will only respond to those requests that are related to the accessibility of the online application system due to a disability.

Having technical issues? View the FAQs for help.

Hiring Process

Where Does Your Story Begin?

Explore Disney Careers and the Life at Disney blog to learn about all the amazing opportunities waiting to be discovered at The Walt Disney Company.
Be Part of the Story

There are many different brands and businesses to explore. Once you've found the opportunity that is right for you, take the next step by completing your application.
The Next Chapter

Once you've applied, you will receive an email allowing you to access your candidate dashboard. Create your login and make sure to check your dashboard often to see your application progress.

Explore this Location Santa Monica, CA

Basking in sunshine 280 days of the year and located just 20 minutes west of Downtown Los Angeles, Santa Monica is a walkable oasis teeming with outdoor adventures, luxury wellness spas and opportunities to kick back under blue skies and awe-inspiring sunsets.