QBrainX - Data Engineering Lead - Azure Databricks

3 weeks ago

chennai, India QBrainX Full time

Job Title : Data Engineering Lead (With Architecture Experience)

Exp level : 10+ years

Location : Coimbatore

Position Type : Full-Time

No of opening : 2

- Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.

Key Responsibilities :

Architect and Design Data Solutions :

- Collaborate with cross-functional teams to understand business requirements and design scalable and efficient data solutions.

- Define data architectures, data models, and data integration strategies to meet business objectives.

- Provide technical leadership in designing and implementing data pipelines, ETL processes, and data warehousing solutions.

Snowflake Expertise :

- Leverage your in-depth knowledge of Snowflake technologies to build and optimize data warehouses.

- Develop and maintain Snowflake data models and schemas to support reporting and analytics needs.

- Familiarity with Snowflake best practices, such as cost analysis, resource allocation, data loading strategies (e.g., bulk loading, incremental loading), and security configurations

Azure and Databricks Proficiency :

- Utilize Azure cloud services and Databricks platforms to manage and process large datasets efficiently.

- Build, deploy, and maintain data pipelines on Azure Data Factory, Azure Databricks, and other Azure services.

Data Warehousing and Integration :

- Implement best practices for data warehousing, ensuring data quality, consistency, and reliability.

- Create and manage data integration processes, including real-time and batch data movement between systems.

SQL and PL/SQL Mastery :

- Write complex SQL and PL/SQL queries to extract, transform, and load data effectively.

- Optimize SQL queries and database performance for high volume data processing.

Performance Tuning and Optimization :

- Continuously monitor and enhance the performance of data pipelines and data storage systems.

- Troubleshoot and resolve data-related issues to minimize downtime.

Documentation and Collaboration :

- Document data engineering processes, data flows, and architectural decisions.

- Collaborate with data scientists, analysts, and other stakeholders to ensure data availability and usability.

Security and Compliance :

- Implement data security measures and adhere to compliance standards (e.g., GDPR, HIPAA) to protect sensitive data.

Apart from 10+ years' experience and the technical skills like Snowflake, Azure Databricks etc., need to showcase below abilities :

- Initiate and drive data engineering strategies.

- Assist and engage with Data engineering sales, proposal activities.

- Develop strong customer relationships for ongoing business.

- Experienced with the Cloud-based Data Solution Architectures, especially in Snowflake.

- Experience with client engagement & aligning others to your ideas/solutions.

- Experience leading a technical team.

- Ability to clarify/translate customer requirements into Epics/Stories & remove ambiguity.

- Ability to mentor other DE team members.

Qualifications :

- Bachelor's or master's degree in computer science, Information Technology, or related field.

- Over 10 years of experience in Data Engineering, with a strong focus on architecture.

- Proven expertise in Snowflake, Azure, and Databricks technologies.

- Comprehensive knowledge of data warehousing concepts, ETL processes, and data integration techniques.

- Exceptional SQL and PL/SQL skills.

- Experience with performance tuning and optimization of data pipelines.

- Strong problem-solving skills and the ability to work in a fast-paced, collaborative environment.

- Excellent communication skills to convey technical concepts to non-technical stakeholders.

- Certifications in relevant technologies (e.g., Snowflake, Azure) are a plus.

(ref:hirist.tech)

  • Data Engineering Lead

    4 weeks ago

    Coimbatore/Tamil Nadu/Kerala/Chennai/Pondicherry/Bangalore/Cochin/Kochi/Hosur, India QBrainX Full time

    Job Title : Data Engineering Lead (With Architecture Experience) Exp level : 10+ years Location : Coimbatore Position Type : Full-Time No of opening : 2- Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.Key Responsibilities : Architect and Design Data Solutions : - Collaborate with cross-functional teams to understand business...

  • Data Engineering Lead

    4 weeks ago

    Coimbatore/Tamil Nadu/Kerala/Chennai/Pondicherry/Bangalore/Cochin/Kochi/Hosur, IN QBrainX Full time

    Job Title : Data Engineering Lead (With Architecture Experience) Exp level : 10+ yearsLocation : Coimbatore Position Type : Full-Time No of opening : 2- Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.Key Responsibilities : Architect and Design Data Solutions : - Collaborate with cross-functional teams to understand business...

  • QBrainX - Data Engineer - Snowflake DB/Azure Databricks

    3 weeks ago

    Chennai, India QBrainX Full time

    Job title : Mid-Level Data Engineer / Data DeveloperExp : 7+ yearsJob Location : Coimbatore / Hyderabad / RemotePosition Type : Full-TimeNo of positions : 2Immediate Joiner (OR) Who can join us within 15 to 30 days is preferred.Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a...

  • QBrainX - Data Engineer - Snowflake DB/Azure Databricks

    3 weeks ago

    Anywhere in India/Multiple Locations/Bangalore/Chennai/Kerala/Tamil Nadu/Andhra Pradesh/Gurgaon/Guru QBrainX Full time

    Job title : Mid-Level Data Engineer / Data DeveloperExp : 7+ yearsJob Location : Coimbatore / Hyderabad / RemotePosition Type : Full-TimeNo of positions : 2Immediate Joiner (OR) Who can join us within 15 to 30 days is preferred. Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data...

  • QBrainX - Data Engineer - Snowflake DB/Azure Databricks

    2 weeks ago

    Anywhere in India/Multiple Locations/Bangalore/Chennai/Kerala/Tamil Nadu/Andhra Pradesh/Gurgaon/Guru, IN QBrainX Full time

    Job title : Mid-Level Data Engineer / Data DeveloperExp : 7+ yearsJob Location : Coimbatore / Hyderabad / RemotePosition Type : Full-TimeNo of positions : 2Immediate Joiner (OR) Who can join us within 15 to 30 days is preferred.Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a...

  • Lead Data Engineer

    1 week ago

    Chennai, India DigiMoksha Solutions Full time

    Job Description :Role Overview : As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal candidate will have extensive experience in cloud-based data...

  • Lead Data Engineer

    6 days ago

    Chennai, India DigiMoksha Solutions Full time

    Job Description : Role Overview : As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal candidate will have extensive experience in cloud-based data...

  • Lead Data Engineer

    7 days ago

    chennai, India DigiMoksha Solutions Full time

    Job Description : Role Overview : As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal candidate will have extensive experience in cloud-based data...

  • Lead Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India DigiMoksha Solutions Full time

    Job Description :Role Overview : As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal candidate will have extensive experience in cloud-based data...

  • Eucloid - Lead Data Engineer - Python/Azure Databricks

    4 weeks ago

    Chennai, India Eucloid Data Solutions Pvt Ltd Full time

    Role : Lead Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some of...

  • Eucloid - Lead Data Engineer - Python/Azure Databricks

    1 week ago

    chennai, India Eucloid Data Solutions Pvt Ltd Full time

    Role : Lead Data Engineer (Databricks) About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some of...

  • Eucloid - Lead Data Engineer - Python/Azure Databricks

    4 weeks ago

    Chennai, India Eucloid Data Solutions Pvt Ltd Full time

    Role : Lead Data Engineer (Databricks) About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some of...

  • Data Engineer

    4 weeks ago

    Chennai, India Astonishic LLC Full time

    Title : Data Engineer - Databricks Specialist Location : Chennai, Tamil Nadu Experience : 2-6 years Employment Type : OnsiteNumber of Positions : 10Job Description :- Design, build, and maintain scalable and robust data pipelines using Databricks.- Develop and optimize data processing using Apache Spark and related technologies.- Collaborate with...

  • Data Engineer

    4 weeks ago

    Chennai, India Astonishic LLC Full time

    Title : Data Engineer - Databricks Specialist Location : Chennai, Tamil Nadu Experience : 2-6 years Employment Type : OnsiteNumber of Positions : 10Job Description :- Design, build, and maintain scalable and robust data pipelines using Databricks.- Develop and optimize data processing using Apache Spark and related technologies.- Collaborate with...

  • Data Engineer

    3 weeks ago

    chennai, India Astonishic LLC Full time

    Title : Data Engineer - Databricks Specialist Location : Chennai, Tamil Nadu Experience : 2-6 years Employment Type : OnsiteNumber of Positions : 10Job Description :- Design, build, and maintain scalable and robust data pipelines using Databricks.- Develop and optimize data processing using Apache Spark and related technologies.- Collaborate with...

  • Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Astonishic LLC Full time

    Title : Data Engineer - Databricks Specialist Location : Chennai, Tamil Nadu Experience : 2-6 years Employment Type : OnsiteNumber of Positions : 10Job Description :- Design, build, and maintain scalable and robust data pipelines using Databricks.- Develop and optimize data processing using Apache Spark and related technologies.- Collaborate with...

  • Eucloid - Data Engineer - Azure Databricks

    4 weeks ago

    Gurgaon/Gurugram/Chennai, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...

  • Data Engineer

    4 weeks ago

    Chennai, India ResourceTree Global Services Full time

    Job Description : ResourceTree Global Services is hiring Senior Data Engineer Role for one of its Data Analytics Client. Below are the details Role : Senior Data Engineer - AzurePrimary Skills : ADF (Azure Data Factory), SQLExperience : 4 - 6 Years Location : ChennaiRole Responsibilities : Translate functional specifications and change requests into...

  • Manager (Big Data)

    4 weeks ago

    Chennai, India Databricks Full time

    CSQ325R53As aBig Data Managerin our Professional Services team you will work with clients on short to medium term customer engagements on theirbig data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to...

  • Manager (Big Data)

    2 weeks ago

    Chennai, Tamil Nadu, India Databricks Full time

    CSQ325R53As aBig Data Managerin our Professional Services team you will work with clients on short to medium term customer engagements on theirbig data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to...