Lead Data Engineer
Dow Jones is seeking a Lead Data Engineer to join our team in Barcelona working on the DNA platform, a Google Cloud and Strata Data award winning Data as a Service platform. The DNA platform provides our clients batch extractions of up to 1.5 billion news articles and real time news streams from over 30,000 sources. https://www.dowjones.com/dna
Design, develop and deploy backend services in Scala
Design, develop and deploy data pipelines in Google Cloud Dataflow and Apache Spark in Scala
Write unit and integration tests
Write analytical SQL queries on Big Query
Provides advice, guidance and training to other teammates
Bachelor's degree or equivalent work experience in Computer Science or related field of study
Writing modern batch and streaming data pipelines (Apache Spark, Beam, ect.)
Experience with CI/CD technologies such as Jenkins, Google Cloud Build or TeamCity
Google Cloud Big Data tools (Dataflow, Dataproc, BigQuery)
FP Scala libraries (cats, scalaz, http4s and doobie)
Exposure to Docker, Kubernetes or other cloud or container based application deployment
Dow Jones , Making Careers Newsworthy
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, protected veteran status, or disability status. EEO/AA/M/F/Disabled/Vets .
Dow Jones is committed to providing reasonable accommodation for qualified individuals with disabilities, in our job application and/or interview process. If you need assistance or accommodation in completing your application, due to a disability, please reach out to us at TalentResourceTeam@dowjones.com . Please put “Reasonable Accommodation" in the subject line.
Business Area: TECHNOLOGY - PRODUCT DEVELOPMENT
Job Category: IT Development Group
Dow Jones is a global provider of news and business information, delivering content to consumers and organizations around the world across multiple formats, including print, digital, mobile and live events. Dow Jones has produced unrivaled quality content for more than 125 years and today has one of the world’s largest news gathering operations globally. It produces leading publications and products including the flagship Wall Street Journal, America’s largest newspaper by paid circulation; Factiva, Barron’s, MarketWatch, Financial News, DJX, Dow Jones Risk & Compliance, Dow Jones Newswires, and Dow Jones VentureSource.Dow Jones is a division of News Corp (NASDAQ: NWS, NWSA; ASX: NWS, NWSLV).
If you are a current employee at Dow Jones, do not apply here. Please go to the Career section on your Workday homepage and view "Find Jobs - Dow Jones." Thank you.
Req ID: 15193