Data Engineer II

  • Location: Dublin, CA
  • Type: Direct Hire
  • Remote
  • Job #9030

The Data Engineer II plays a critical role in engineering of data solutions that support the reporting and analytic needs. As a key member of the Data engineering team, will work on diverse data technologies such as Steramsets, dbt, data ops and others to build insightful, scalable, and robust data pipelines that feed our various analytics platforms.

ESSENTIAL FUNCTIONS:

• Design and Model data engineering pipelines that support company reporting and analytic needs.

• Engineer efficient, adaptable, and scalable data pipelines for moving data from different sources into our Cloud Lakehouse

• Understand and analyze business requirements and translate into well-architected solutions that demonstrate the modern BI & Analytics platform

• Be a part of data modernization projects providing direction on matters of overall design and technical direction, acts as the primary driver toward establishing guidelines and approaches

• Develop and deploy performance optimization methodologies

• Drive timely and proactive issue identification, escalation & resolution

• Collaborate effectively within Data Technology teams, Business Information teams to design and build optimized data flows from source to Data visualization

COMPETENCIES:

People

• Building Effective Teams (for managers of People and Projects)

• Developing Talent (for managers of people only, N/A for this role/level)

• Collaboration

Self

• Leading by Example

• Communicates Effectively

• Ensures Accountability and Execution

• Manages Conflict

Business

• Business Acumen

• Plans, Aligns and Prioritizes

• Organizational Agility

QUALIFICATIONS AND SPECIAL SKILLS REQUIRED:

• At least 7 years in-depth, data engineering experience and execution of data pipelines, data ops, scripting and SQL queries

• 5+ years proven data modeling skills – must have demonstrable experience designing models for data warehousing and modern analytics use-cases (e.g., from operational data store to semantic models)

• 2-3 years’ experience in modern data architecture that support advanced analytics including Snowflake, Azure, etc. Experience with Snowflake and other Cloud Data Warehousing / Data Lake preferred

• Bachelor’s Degree in Computer Science, Information Systems, Engineering, Business Analytics, or Business Management

• Expert in engineering data pipelines using various data technologies – ETL/ELT, big data technologies (Hive, Spark) on large-scale data sets demonstrated through years of experience

• Hands on data warehouse design, development, and data modeling best practices for modern data architectures

• Highly proficient in at least one of these programming languages: Java, Python

• Experience with modern data modelling tools, data preparation tools

• Experience with adding data lineage, technical glossary from data pipelines to data catalog tools

• Highly proficient in Data analysis – analyzing SQL, Python scripts, ETL/ELT transformation scripts

• Highly skilled in data orchestration with experience in tools like Ctrl-M, Apache Airflow. Hands on DevOps/Data Ops experience required

• Knowledge/working experience in reporting tools such as MicroStrategy, Power BI would be a plus

• Self-driven individual with the ability to work independently or as part of a project team

• Experience working in an Agile Environment preferred, Familiarity with Retail domain preferred

• Experience with Streamsets, dbt preferred

• Strong communication skills are required with the ability to give and receive information, explain complex information in simple terms and maintain a strong customer service approach to all users

Estimated Compensation: $96,000 - $182,000 Per Year
Attach a resume file. Accepted file types are DOC, DOCX, PDF, HTML, and TXT.

We are uploading your application. It may take a few moments to read your resume. Please wait!

MEET YOUR RECRUITER

Vanda AlvesVanda Alves

Recruiting Director, Data Engineering & Analytics/BI

(201) 537-0011

LinkedIn profile

Apply

Subscribe

Searching For Something Else?

Connect with a member of our recruiting team today. We're here to help!

Subscribe to our newsletter!

Be the first to receive monthly recruiting insights, hiring trends, job search tips, and more!