Job Posting Title:Data Engineer IIReq ID:10084842Job Description:On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming our media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to enhance flexibility and efficiency, or delivering Disney's unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.A few reasons why we think you'd love working here:
- Building the future of Disney's media: DE&E Technologists are designing and building the infrastructure that will power our media, advertising, and distribution businesses for years to come.
- Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day - from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.
- Innovation: We develop and implement groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.
Platform Software Engineering oversees the core technical platforms and systems for Disney's massive suite of streaming products - including Disney+ and Hulu - and digital products and experiences - including ESPN, Marvel, Disney Studios, NatGeo, and ABC News. This team also drives the strategic development and use of technology, building scalable systems and products that can power a more personalized experience for Disney customers, as well as innovative work in Augmented Reality (AR), Virtual Reality (VR), and 3D rendering in our studio environments. When you're watching Sports Center and you're impressed by how awesome the studio looks, you have this team to thank! As a Software Engineer, you will play a pivotal role in the development, maintenance, and optimization of our security data infrastructure and pipelines. You will be responsible for building up the big data pipeline for rule-based security detection, do data analysis for security feature and incident, and collaborating with engineers in your squad. You will contribute to and be part of an engaging, dynamic and inclusive engineering organization, grounded in scrum and agile practices, CI/CD, great collaboration, functional programming and motivated by a commitment to continuous learning and improvement. Identity Engineering delivers Consumer Identity and Access Management (CIAM) capabilities across The Walt Disney Company (TWDC) including but not limited to: D+, Hulu, ESPN+, and Parks. Identity Engineering squads build and run high-traffic and globally replicated systems which form an integral and visible part of every user's journey at Disney properties. The Security Incident and Management squad is responsible for the design and development of online and offline rule-based Spark jobs to detect malicious traffic and activity across the Identity Engineering platform
Responsibilities:
- Design, develop, maintain, and optimize ETL (Extract, Transform, Load) processes and data pipelines for large-scale data processing.
- Analyze the security incident and provide the solution.
- Promote and support Agile methodologies such as Scrum, Kanban, and Scrum ban by actively participating in regular ceremonies such as stand-up, retrospectives and sprint planning.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement effective solutions
Basic Qualifications:- Bachelor's degree in computer science, Software Engineering, Data Science, or a related field (or equivalent practical experience).
- 3 + years of job experience
- Familiarity with data engineering concepts and technologies (e.g., ETL, Data Pipeline, Spark, Flink)
- Basic knowledge of programming languages (e.g., Java, Scala, Python, or similar).
- Understanding of data storage and database management (e.g., HDFS, S3, Redis, SQL and NoSQL databases).
- Basic knowledge of distributed system development and middleware such as Kafka, Kinesis, etc.
- Experience with ETL tools or data integration platforms is a plus (e.g., Databricks)
- Experience with Identity Security is a plus.
Preferred Qualifications:- Experience with data integration plaWorms is a plus (e.g., Databricks)
- Experience with AWS is a plus.
- Familiarity with data storage and database management (e.g., HDFS, S3, Redis, SQL and NoSQL databases).
- Experience with Identity Security is a plus
#DISNEYTECH The hiring range for this position in New York is $118,000 - $158,200 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.Job Posting Segment:Disney Entertainment & ESPN TechnologyJob Posting Primary Business:Commerce, Growth, & IdentityPrimary Job Posting Category:Software EngineerEmployment Type:Full timePrimary City, State, Region, Postal Code:New York, NY, USAAlternate City, State, Region, Postal Code:Date Posted:2024-04-02