QBrainX - Data Engineering Lead - Python/PySpark

1 month ago


CoimbatoreHyderabadChennaiTamil NaduKeralaAndhra PradeshAnywhere in IndiaMultiple Locations, IN QBrainX Full time

Job title - Data Engineering Lead

Exp - 6 to 8 years

Job Location : Coimbatore / Hyderabad (Work from Office)

Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you

We are searching for a Data Engineering Lead to join our growing team. In this role, you will play a key part in designing, developing, and maintaining our data pipelines. You will work closely with data scientists, analysts, and business stakeholders to ensure our data infrastructure meets the ever-evolving needs of the :

- Design, develop, and maintain scalable data pipelines using technologies like Python and SQL.

- Develop and implement data quality checks and monitoring processes to ensure data integrity.

- Build and automate data ingestion processes from various sources (databases, APIs, etc.) to Snowflake.

- Utilize cloud platforms (AWS, Azure, GCP) to build and manage data infrastructure.

- Leverage Infrastructure as Code (IaC) tools like Terraform to provision and manage cloud resources.

- Collaborate with data scientists and analysts to understand data requirements and translate them into technical solutions.

- Version control code using Git and collaborate with the team through code reviews.

- Document data pipelines and processes for future reference and knowledge sharing.

Qualifications :

- 6 years of experience in data engineering or a related field.

- Proven experience in designing, developing, and deploying data pipelines.

- Hands on experience with Snowflake, DataBricks, Python or Pyspark and SQL.

- Should have experience working in Data Build Tool (DBT) with snowflake is required

- Experience with data warehousing and data modeling concepts.

- Experience working with cloud platforms (AWS, Azure, GCP) is a plus.

- Working knowledge of Terraform and Infrastructure as Code (IaC) principles.

- Experience with Git for version control.

- Excellent communication and collaboration skills.

- Ability to work independently and as part of a team.

- Should have experience in leading the data engineering team.

- Knowledge and Experience toward Architectural and design is added advantage.

- Strong problem-solving and analytical skills.

Bonus Points :

- Experience with data orchestration tools (Airflow, Luigi, etc.).

- Experience with data visualization tools (Tableau, Power BI, etc.)

(ref:hirist.tech)

  • Kerala/Tamil Nadu/Coimbatore, IN QBrainX Full time

    Job title - Data Engineer (Mid-Level)Exp - 3+ to 7 yearsJob Location : Coimbatore (Work from Office)Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you!We are searching for a Mid-Level Data Engineer to join our growing team. In...

  • Lead Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN Gen Full time

    Job Description :Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better...

  • AWS Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN IT Source Global Full time

    We have Immediate Openings on AWS data engineerJob Description :- Data Pipeline Development: Design and develop ETL processes using AWS Glue, Python, and PySpark to extract, transform, and load data from various sources into data lakes or data warehouses.- Data Integration: Integrate data from multiple sources, ensuring data quality, consistency, and...

  • Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN Crescendo Global Full time

    Job Description : Are you an experienced Data Engineer with expertise in Python, Pyspark, and AWS? Our client, a leading technology firm in India, is looking for a Senior Data Engineer to join their team. If you have a strong analytical mindset and a passion for leveraging data to drive business insights, this opportunity is perfect for you.Location : PAN...

  • Lead Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN Gen Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for people - we...


  • Anywhere in India/Multiple Locations, IN Digihelic Solutions Pvt. Ltd. Full time

    Roles & Responsibilities : - Design, write, test and deploy production-ready code primarily using SAS, Python, and Pyspark. - Be an active member of the technical team, contribute ideas and insight in stand-ups and meetings, ask questions, review pull requests, analyze bugs and fixes, and help users and teammates. - Interface with other technical personnel...


  • Anywhere in India/Multiple Locations/Remote/Coimbatore/Hyderabad, IN QBrainX Full time

    ServiceNow Testing LeadExperience Level : 5+ yearsJob Location : RemotePosition Overview :We are looking for a skilled ServiceNow Testing Lead to oversee and enhance our testing processes for ServiceNow implementations. The ideal candidate will have a strong background in ServiceNow testing, quality assurance methodologies, and leadership experience. This...


  • Anywhere in India/Multiple Locations, IN SAN Engineering Solutions Full time

    Job Description : Position : Azure Databricks EngineerExperience Level : 5 - 9 YearsLocation : Pan India (Remote Work Available)Job Type : Full-TimeAvailability : Immediate / Early Joiners PreferredAbout the Role :We are seeking a skilled Azure Databricks Engineer to join our dynamic team. The ideal candidate will have extensive experience in Azure services,...

  • Data Engineer

    2 months ago


    Hyderabad/Anywhere in India/Multiple Locations, IN Circuit Compilers Full time

    Job Description :- 5 to 8 years in the build release management, software configuration, design, development, and cloud implementation.- Data Engineer with expertise in Python, Scala, PySpark, AWS S3, Glue, Redshift, Lambda, DBT, Serverless, Snowflake, SQL, Datalake, and Data Pipeline.- Leveraged AWS Glue for data cataloging, ETL job orchestration, and...

  • Azure Data Lead

    6 months ago


    Anywhere in India/Multiple Locations, IN Etaash Consulting Full time

    Years of experience : 7 to 15 Years Role : Sr. Tech LeadJob Description :- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in creating...

  • Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN IT Source Global Full time

    Role : Data EngineerJob Description :- Design, build, and maintain large-scale data pipelines and ETL/ELT workflows using PySpark, Python, and SQL for data extraction, transformation, and loading.- Work extensively with AWS services such as Amazon S3 for data storage and Athena for querying and analyzing structured and unstructured data.- Develop and manage...

  • Lead Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN ARR Recruitment Solutions Full time

    Job Description :Required skills & experience :- Proficiency in data modeling and database management.- Strong programming skills in Pyspark, Python and SQL.- Experience with ETL (Extract, Transform, Load) processes.- Familiarity with strong data warehousing and Azure cloud platform with immense working knowledge in Databricks. - Knowledge of data governance...

  • Data Engineer

    2 months ago


    Metros/Anywhere in India/Multiple Locations, IN One of the Consulting Firms Full time

    Data Engineer (Python & SQL)Position : Data Engineer (Python & SQL)Locations : Hyderabad, Chennai, Bengaluru, Mumbai, Pune, Kolkata, GurugramJob Type : Full-TimeCompany : Reputed Big 4 MNC client company of Live Connections.Role Overview :We are looking for a skilled Data Engineer with experience in Python, SQL, and Financial Services Industry (FSI) to join...

  • Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations/Bangalore/Hyderabad/Chennai/Pune/Noida, IN TETRAHED INC Full time

    Role : Data EngineerJob Description :We are looking for a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with specific expertise in Oracle to BigQuery data warehouse migration and modernization. This role requires proficiency in various data engineering...

  • Data Analyst

    2 months ago


    Anywhere in India/Multiple Locations/Remote, IN Orangeskill Technologies Pvt Ltd Full time

    Job Title : Data Analyst Location : Remote Experience : 3 - 7 years Job Summary :You will be responsible for providing analytical expertise to the Commercial Organization, driving strategic and operational excellence. This is a hands-on analytical role and as a proactive internal consultant to a specific brand team, the Brand Analytics Analyst will support...

  • Azure Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN estrel.ai Full time

    Job Description :- 5 - 8 years of experience in IT Industry- - 4/5+ years of experience with Azure Data Engineering Stack (Event Hub, Data Factory , Cosmos DB, Synapse, SQL DB, Databricks, Data Explorer) - 3+ years of experience with Python / Pyspark, Spark, Scala, Hive, Impala - Excellent knowledge of SQL and coding skills - Good understanding of other...


  • Anywhere in India/Multiple Locations, IN Selsoftinc Full time

    Job Description :We are seeking a seasoned Palantir Data Visualization Engineer and Data Engineer with at least 3 years of expertise in Palantir Foundry tools to lead a team of 6-8 members. The ideal candidate will be responsible for designing, implementing, and leading data integration and security solutions in Palantir, and for providing data-driven...


  • Anywhere in India/Multiple Locations/Remote/Coimbatore/Hyderabad, IN QBrainX Full time

    Role : ServiceNow ITAM Developer Exp level : 4 -7 Years ExperienceJob Location : RemotePosition Overview : We are looking for an experienced ServiceNow IT Asset Management (ITAM) Developer with 4 to 7 years of experience to enhance and maintain our ITAM solutions within the ServiceNow platform. The ideal candidate will possess strong skills in catalog...

  • Databricks Developer

    1 month ago


    Anywhere in India/Multiple Locations, IN Gen Full time

    About the Company :Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose the relentless pursuit of a world that works better...


  • Coimbatore/Tamil Nadu/Kerala, IN QBrainX Full time

    Job Title : Data Engineering Lead / Architect (With Architecture Experience is MUST)Exp level - 10+ yearsLocation : Coimbatore (Work From Office)Position Type : Full-TimeKey Responsibilities :Architect and Design Data Solutions :- Collaborate with cross-functional teams to understand business requirements and design scalable and efficient data solutions.-...