ETL/Databricks Engineer

2 months ago

Bengaluru, India RS Consultants Full time

ETL (Databricks)

Job description :

Responsibilities :

- Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets.

- Collaborate with Business Intelligence team and other stakeholders for data requirements

- Collaborate with the Data Management team to provide quality data to stakeholders.

- Build data expertise and learn company history needed to effectively design data pipelines.

General Requirements :

- Highly collaborative and empathic approach to problem solving

- Naturally curious with the drive to learn what is needed to identify root cause

- Capable of actioning high-level, sometimes ambiguous requirements into operational tools/dashboards

- Demonstrated organizational skills, attention to detail and ability to work independently while staying integrated with the broader Data Engineering team as well as stakeholders

- A strategist with sound business and technical acumen.

Proven ability to influence at various levels of leadership, without direct authority

- Strong problem-solving skills (critical, strategic, and evaluative thinking)

- Ability to synthesize complex data concepts into easily comprehended messages

Technical Skill Requirements :

- Data Collection Tools

- Knowledge of data modeling and design of schemas for read and write performance.

- Build Processes supporting data transformation, data structures, metadata, dependency, and workload management.

- Knowledge of message queuing, stream processing, API based extraction and highly scalable 'big data' data stores

- Experience in Python and SQL.

Experience with Boomi is a plus.

- ETL Automation - experience with building data pipelines from business applications like Salesforce, Marketo, NetSuite, Workday and Jira

- Knowledge of Databricks Platform

- Knowledge of AI/ML/ Data Science

- Knowledge of BI Tools like Tableau, Looker etc

Education & Experience :

- Bachelor's degree required in related field

- Minimum 5 years related work experience

- Ongoing education in an area related to Data Analytics (Data Sciences, Mathematics, Statistics, Industrial Psychology, Organizational Behavior, or Finance/Accounting) preferred

- Experience working in a high growth company preferred

Keywords : ETL, Databricks, Python, databricks, SQL

Location : Remote

CTC : 18 LPA

(ref:hirist.tech)

  • Senior Azure Data Engineer

    2 weeks ago

    Bengaluru, India Techno Wise Full time

    Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...

  • Senior Azure Data Engineer

    2 months ago

    Bengaluru, India Techno Wise Full time

    Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...

  • Azure Etl + Databricks

    1 month ago

    Bengaluru, Karnataka, India Skillety Technologies Full time

    **Job Title**: Azure ETL + DataBricks

  • Databricks Engineer

    2 months ago

    Bengaluru, India Unilode Full time

    Databricks Engineer Position Overview The job purpose of a Databricks Engineer is to be a key contributor in ensuring that an organization’s data is processed efficiently, securely, and accurately using the Databricks platform. They support data analytics, provide technical expertise, manage platform resources, and optimize data workflows to help...

  • Lead Databricks Engineer

    23 hours ago

    Bengaluru, Karnataka, India Impetus Technologies Full time

    Job Tittle Lead Databricks EngineerDatabricks Engineers with 2 6 years of hand on experience in Pyspark, Cloud Platform and SQL.Proven experience in designing and implementing data solutions on the Databricks platform with hands on experience in setting up Databricks cluster, working in Databricks modules, data pipelines for ingesting and transforming data...

  • Lead Databricks Engineer

    1 week ago

    Bengaluru, India Impetus Technologies Full time

    Job Tittle - Lead Databricks EngineerDatabricks Engineers with 2-6 years of hand-on experience in Pyspark, Cloud Platform and SQL.Proven experience in designing and implementing data solutions on the Databricks platform with hands on experience in setting up Databricks cluster, working in Databricks modules, data pipelines for ingesting and transforming...

  • ETL Data Engineer

    2 months ago

    Bengaluru, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

  • ETL Data Engineer

    2 weeks ago

    Bengaluru, India Codersbrain technology pvt ltd Full time

    Job Description: ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.- Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness- Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.- Diagnose system...

  • Databricks Architect

    13 hours ago

    Bengaluru, India Impetus Full time

    Joh DescriptionOverall 8-14 yrs. of Data Engineering experience with 4+ years of hands on experience in Databricks.Proven experience as a Databricks Architect or similar role with a deep understanding of the Databricks platform and its capabilities.Analyze business requirements and translate them into technical specifications for data pipelines, data lakes,...

  • Databricks Engineer

    1 day ago

    Bengaluru, Karnataka, India Hunarstreet Technologies Full time

    Databricks Role Overview : As a Data Engineer specializing in Databricks, you will play a pivotal role in collaborating with our clients to leverage the Databricks platform for extracting actionable insights from their data. From designing and implementing scalable data pipelines to optimizing workflows and fostering cross-functional collaboration, you will...

  • Azure Etl + Databricks

    1 month ago

    Bengaluru, Karnataka, India Skillety Technologies Full time

    **Job Description**: **Job Title**: Azure ETL + DataBricks About Company Skillety is a gig-economy startup crowdsourcing platform. We provide various types of Staffing services like Full-Time, Part-time, Contractors & Freelancers. We help our Clients to move away from the old and soiled hierarchical business structure, and evolve into a 21st Century...

  • Azure Databricks Engineer

    18 hours ago

    Bengaluru, Karnataka, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...

  • Azure Databricks Engineer

    21 hours ago

    Bengaluru, Karnataka, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 3-12 years Location: Bangalore, Chennai, Delhi, Pune, Kolkata About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest...

  • Azure Databricks Engineer

    2 months ago

    Bengaluru, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 3-12 years Location: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...

  • Azure Databricks Engineer

    2 months ago

    Bengaluru, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 3-12 years Location: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...

  • Azure Databricks Engineer

    2 months ago

    Bengaluru, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 3-12 years Location: Bangalore, Chennai, Delhi, Pune, Kolkata About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest...

  • Azure Databricks Engineer

    20 hours ago

    Bengaluru, Karnataka, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead Experience: 5-10 years Location: Bangalore, Chennai, Delhi, Pune, Kolkata About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across...

  • Databricks Architect

    3 days ago

    Bengaluru, India Impetus Full time

    Joh DescriptionOverall 8-14 yrs. of Data Engineering experience with 4+ years of hands on experience in Databricks.Proven experience as a Databricks Architect or similar role with a deep understanding of the Databricks platform and its capabilities.Analyze business requirements and translate them into technical specifications for data pipelines, data lakes,...

  • Azure Databricks Engineer

    19 hours ago

    Bengaluru, Karnataka, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead Experience: 5-10 years Location: Bangalore, Chennai, Delhi, Pune, Kolkata About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering.The largest companies across industries...

  • Databricks Consultant

    16 hours ago

    Bengaluru, Karnataka, India Overture Rede Private Limited. Full time

    Job Description : Bachelor's degree in Computer Science, Information Technology, or a related field.- Apache Spark and Delta Lake expertise Hands-on experience with big data pipelines.- Programming skills : Proficiency in Python, Scala, or SQL.- Databricks platform experience and its features and capabilities.- Data engineering background : Solid...