Data Engineering Lead

1 month ago

CoimbatoreTamil NaduKeralaChennaiPondicherryBangaloreCochinKochiHosur, IN QBrainX Full time

Job Title : Data Engineering Lead (With Architecture Experience)

Exp level : 10+ years

Location : Coimbatore

Position Type : Full-Time

No of opening : 2

- Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.

Key Responsibilities :

Architect and Design Data Solutions :

- Collaborate with cross-functional teams to understand business requirements and design scalable and efficient data solutions.

- Define data architectures, data models, and data integration strategies to meet business objectives.

- Provide technical leadership in designing and implementing data pipelines, ETL processes, and data warehousing solutions.

Snowflake Expertise :

- Leverage your in-depth knowledge of Snowflake technologies to build and optimize data warehouses.

- Develop and maintain Snowflake data models and schemas to support reporting and analytics needs.

- Familiarity with Snowflake best practices, such as cost analysis, resource allocation, data loading strategies (e.g., bulk loading, incremental loading), and security configurations

Azure and Databricks Proficiency :

- Utilize Azure cloud services and Databricks platforms to manage and process large datasets efficiently.

- Build, deploy, and maintain data pipelines on Azure Data Factory, Azure Databricks, and other Azure services.

Data Warehousing and Integration :

- Implement best practices for data warehousing, ensuring data quality, consistency, and reliability.

- Create and manage data integration processes, including real-time and batch data movement between systems.

SQL and PL/SQL Mastery :

- Write complex SQL and PL/SQL queries to extract, transform, and load data effectively.

- Optimize SQL queries and database performance for high volume data processing.

Performance Tuning and Optimization :

- Continuously monitor and enhance the performance of data pipelines and data storage systems.

- Troubleshoot and resolve data-related issues to minimize downtime.

Documentation and Collaboration :

- Document data engineering processes, data flows, and architectural decisions.

- Collaborate with data scientists, analysts, and other stakeholders to ensure data availability and usability.

Security and Compliance :

- Implement data security measures and adhere to compliance standards (e.g., GDPR, HIPAA) to protect sensitive data.

Apart from 10+ years' experience and the technical skills like Snowflake, Azure Databricks etc., need to showcase below abilities :

- Initiate and drive data engineering strategies.

- Assist and engage with Data engineering sales, proposal activities.

- Develop strong customer relationships for ongoing business.

- Experienced with the Cloud-based Data Solution Architectures, especially in Snowflake.

- Experience with client engagement & aligning others to your ideas/solutions.

- Experience leading a technical team.

- Ability to clarify/translate customer requirements into Epics/Stories & remove ambiguity.

- Ability to mentor other DE team members.

Qualifications :

- Bachelor's or master's degree in computer science, Information Technology, or related field.

- Over 10 years of experience in Data Engineering, with a strong focus on architecture.

- Proven expertise in Snowflake, Azure, and Databricks technologies.

- Comprehensive knowledge of data warehousing concepts, ETL processes, and data integration techniques.

- Exceptional SQL and PL/SQL skills.

- Experience with performance tuning and optimization of data pipelines.

- Strong problem-solving skills and the ability to work in a fast-paced, collaborative environment.

- Excellent communication skills to convey technical concepts to non-technical stakeholders.

- Certifications in relevant technologies (e.g., Snowflake, Azure) are a plus.

(ref:hirist.tech)

  • Lead Data Engineer

    1 month ago

    Chennai/Cochin/Kochi/Coimbatore/Hyderabad, IN DigiMoksha Solutions Full time

    Position : Lead Data EngineerExperience : 10-15 YearsLocation : Period : Immediate Description :As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal...

  • Lead Data Engineer

    3 weeks ago

    Chennai/Cochin/Kochi/Coimbatore/Hyderabad, IN DigiMoksha Solutions Full time

    Position : Lead Data EngineerExperience : 10-15 YearsLocation : Period : Immediate Description :As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal...

  • Senior Power BI Data Analyst

    2 months ago

    Bangalore/Cochin/Kochi, IN INSIGHT GLOBAL SOLUTIONS Full time

    The On-Account Data Steward plays a key role in supporting the data governance program of one of our customer's accounts. They are responsible for supporting the establishment and maintenance of an effective data governance framework, ensuring data quality, integrity, compliance, data stewardship, and metadata management activities. With a deep...

  • Wavicle Data Solutions

    3 weeks ago

    Bangalore/Chennai/Coimbatore/Tamil Nadu, IN Wavicle data solutions Full time

    Job Description :We are seeking an experienced RPA Solutions Architect with a proven track record in the realm of Robotic Process Automation (RPA). The ideal candidate will possess a deep understanding of RPA technologies, particularly Blue Prism and other prominent RPA tools, and demonstrate expertise in deploying RPA solutions within cloud environments. As...

  • Wavicle Data Solutions

    2 months ago

    Bangalore/Chennai/Coimbatore/Tamil Nadu, IN Wavicle data solutions Full time

    Job Description :We are seeking an experienced RPA Solutions Architect with a proven track record in the realm of Robotic Process Automation (RPA). The ideal candidate will possess a deep understanding of RPA technologies, particularly Blue Prism and other prominent RPA tools, and demonstrate expertise in deploying RPA solutions within cloud environments. As...

  • Data Scientist

    2 months ago

    Cochin/Kochi/Kerala/Bangalore, IN Career Foresight HR Solutions Full time

    We have an opening for Data Scientist in Kochi/Bangalore/ WFH. Designation - Data ScientistExp : 8+ Yrs.Location : Kochi/Bangalore/WFHNotice Period : 15 Days/Immediate Joiners PreferredJD :- Data Analysis : Extract, clean, and pre-process data from various sources. - Perform exploratory data analysis to understand patterns, trends, and relationships in the...

  • Data Scientist

    3 weeks ago

    Cochin/Kochi/Kerala/Bangalore, IN Career Foresight HR Solutions Full time

    We have an opening for Data Scientist in Kochi/Bangalore/ WFH. Designation - Data ScientistExp : 8+ Yrs.Location : Kochi/Bangalore/WFHNotice Period : 15 Days/Immediate Joiners PreferredJD :- Data Analysis : Extract, clean, and pre-process data from various sources. - Perform exploratory data analysis to understand patterns, trends, and relationships in the...

  • Engineering Director/Technical Director/Technical Manager

    3 weeks ago

    Kerala/Tamil Nadu/Coimbatore, IN QBrainX Full time

    Title : Director - Engineering / Technical Director / Technical managerExp level : 15 to 18 yearsJob location : Coimbatore (Work from Office)As an engineering director or technical director, you play a pivotal role in leading and guiding the technical aspects of a company's projects and initiatives. Your job description typically includes a combination...

  • Engineering Director/Technical Director/Technical Manager

    3 weeks ago

    Kerala/Tamil Nadu/Coimbatore, IN QBrainX Full time

    Title : Director - Engineering / Technical Director / Technical managerExp level : 15 to 18 yearsJob location : Coimbatore (Work from Office)As an engineering director or technical director, you play a pivotal role in leading and guiding the technical aspects of a company's projects and initiatives. Your job description typically includes a combination...

  • Data Architect

    3 weeks ago

    Chennai/Cochin/Kochi/Coimbatore/Mumbai, IN DigiMoksha Solutions Full time

    Position : Data : 10+ YearsLocation : Period : Only Immediate JoinersJob Description :We are seeking an experienced Data Architect with a specialization in Snowflake to join our team. The ideal candidate will have a strong background in data architecture and at least 10 years of experience in the field, with extensive knowledge and expertise in Snowflake...

  • Data Architect

    3 weeks ago

    Chennai/Cochin/Kochi/Coimbatore/Mumbai, IN DigiMoksha Solutions Full time

    Position : Data : 10+ YearsLocation : Period : Only Immediate JoinersJob Description :We are seeking an experienced Data Architect with a specialization in Snowflake to join our team. The ideal candidate will have a strong background in data architecture and at least 10 years of experience in the field, with extensive knowledge and expertise in Snowflake...

  • Data Lead Engineer

    3 weeks ago

    Bangalore/Delhi, IN Squareroot Consulting Pvt Ltd Full time

    Job Description :We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...

  • Data Lead Engineer

    2 months ago

    Bangalore/Delhi, IN Squareroot Consulting Pvt Ltd Full time

    Job Description :We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...

  • Senior Data Engineer

    4 days ago

    Bangalore/Chennai/Hyderabad, IN PPLABILITY PRIVATE LIMITED Full time

    Job Title: Senior Data Engineer-Data Modeling. Location: Bengaluru, Chennai, about the role? What your typical day would look like? As a Senior Data Engineer, you will work to solve some of the organizational data management problems that would enable them as a data-driven organization; Seamlessly switch between roles of an Individual Contributor, team...

  • Lead Data Engineer

    2 months ago

    Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Lead Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune)Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...

  • Lead Data Engineer

    3 weeks ago

    Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Lead Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune)Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...

  • Lead Data Engineer

    2 months ago

    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    We are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...

  • Lead Data Engineer

    3 weeks ago

    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    We are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...

  • Datadivr - Machine Learning Engineer - Python/Django

    3 weeks ago

    Chennai/Cochin/Kochi, IN DATADIVR PRIVATE LIMITED Full time

    About Us : Datadivr is not just another data science company; we are visionaries in a digital age. Anchored by integrity and a genuine stake in every project, our mission goes beyond mere data analysis. We believe in the transformative power of data, and with our unparalleled expertise, we are dedicated to empowering enterprises to navigate the digital...

  • Datadivr - Machine Learning Engineer - Python/Django

    3 weeks ago

    Chennai/Cochin/Kochi, IN DATADIVR PRIVATE LIMITED Full time

    About Us : Datadivr is not just another data science company; we are visionaries in a digital age. Anchored by integrity and a genuine stake in every project, our mission goes beyond mere data analysis. We believe in the transformative power of data, and with our unparalleled expertise, we are dedicated to empowering enterprises to navigate the digital...