We break stories, influence ideas, and advance business intelligence and cultural interest. We expose the events that turn markets, the digital breakthroughs that transform art, the demand that drives invention, as well as the political and societal passing moments and lasting consequences. We are the people of Dow Jones. From different fields, backgrounds and viewpoints we invite you to join us.
Examine the world and bring it to others.
Job Description:
Department/Product Overview:
Dow Jones is seeking a Principal Data Engineer to join our team in Barcelona working on the DNA platform, a Google Cloud and Strata Data award winning Data as a Service platform. The DNA platform provides our clients batch extractions of up to 1.5 billion news articles and real time news streams from over 30,000 sources. https://www.dowjones.com/dna* Primary Responsibilities/Accountabilities:*
Define and implement system architecture and programming standards
Partner effectively with product team to manage scope and deliverables for the technical side of the product roadmap
Able to identify areas of strategic technical debt and provide cost/benefit analysis for eliminating tech debt and identify suggested timelines for prioritizing
Design, develop and deploy backend services in Scala
Design, develop and deploy data pipelines in Google Cloud Dataflow and Apache Spark in Scala
Write unit and integration tests
Write analytical SQL queries on Big Query
Provides advice, guidance and training to other teammates
Knowledge/Experience:
Bachelor's degree or equivalent work experience in Computer Science or related field of study
Functional programming
Writing modern batch and streaming data pipelines (Apache Spark, Beam, ect.)
Experience with CI/CD technologies such as Jenkins, Google Cloud Build or TeamCity
Preferred Tools/Skills:
Google Cloud Big Data tools (Dataflow, Dataproc, BigQuery)
FP Scala libraries (cats, scalaz, http4s and doobie)
Exposure to Docker, Kubernetes or other cloud or container based application deployment
#bcntech
Dow Jones , Making Careers Newsworthy
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, protected veteran status, or disability status. EEO/AA/M/F/Disabled/Vets .
Dow Jones is committed to providing reasonable accommodation for qualified individuals with disabilities, in our job application and/or interview process. If you need assistance or accommodation in completing your application, due to a disability, please reach out to us at TalentResourceTeam@dowjones.com . Please put “Reasonable Accommodation" in the subject line.
Business Area: TECHNOLOGY - PRODUCT DEVELOPMENT
Job Category: IT Development Group
About Us
Dow Jones is a global provider of news and business information, delivering content to consumers and organizations around the world across multiple formats, including print, digital, mobile and live events. Dow Jones has produced unrivaled quality content for more than 125 years and today has one of the world’s largest news gathering operations globally. It produces leading publications and products including the flagship Wall Street Journal, America’s largest newspaper by paid circulation; Factiva, Barron’s, MarketWatch, Financial News, DJX, Dow Jones Risk & Compliance, Dow Jones Newswires, and Dow Jones VentureSource.Dow Jones is a division of News Corp (NASDAQ: NWS, NWSA; ASX: NWS, NWSLV).
Req ID: 15194
