QBrainX - Data Engineering Lead - Python/PySpark

1 week ago


CoimbatoreHyderabadChennaiTamil NaduKeralaAndhra PradeshAnywhere in IndiaMultiple Locations, IN QBrainX Full time

Job title - Data Engineering Lead

Exp - 6 to 8 years

Job Location : Coimbatore / Hyderabad (Work from Office)

Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you

We are searching for a Data Engineering Lead to join our growing team. In this role, you will play a key part in designing, developing, and maintaining our data pipelines. You will work closely with data scientists, analysts, and business stakeholders to ensure our data infrastructure meets the ever-evolving needs of the :

- Design, develop, and maintain scalable data pipelines using technologies like Python and SQL.

- Develop and implement data quality checks and monitoring processes to ensure data integrity.

- Build and automate data ingestion processes from various sources (databases, APIs, etc.) to Snowflake.

- Utilize cloud platforms (AWS, Azure, GCP) to build and manage data infrastructure.

- Leverage Infrastructure as Code (IaC) tools like Terraform to provision and manage cloud resources.

- Collaborate with data scientists and analysts to understand data requirements and translate them into technical solutions.

- Version control code using Git and collaborate with the team through code reviews.

- Document data pipelines and processes for future reference and knowledge sharing.

Qualifications :

- 6 years of experience in data engineering or a related field.

- Proven experience in designing, developing, and deploying data pipelines.

- Hands on experience with Snowflake, DataBricks, Python or Pyspark and SQL.

- Should have experience working in Data Build Tool (DBT) with snowflake is required

- Experience with data warehousing and data modeling concepts.

- Experience working with cloud platforms (AWS, Azure, GCP) is a plus.

- Working knowledge of Terraform and Infrastructure as Code (IaC) principles.

- Experience with Git for version control.

- Excellent communication and collaboration skills.

- Ability to work independently and as part of a team.

- Should have experience in leading the data engineering team.

- Knowledge and Experience toward Architectural and design is added advantage.

- Strong problem-solving and analytical skills.

Bonus Points :

- Experience with data orchestration tools (Airflow, Luigi, etc.).

- Experience with data visualization tools (Tableau, Power BI, etc.)

(ref:hirist.tech)

  • Kerala/Tamil Nadu/Coimbatore, IN QBrainX Full time

    Job title - Data Engineer (Mid-Level)Exp - 3+ to 7 yearsJob Location : Coimbatore (Work from Office)Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you!We are searching for a Mid-Level Data Engineer to join our growing team. In...

  • Lead Data Engineer

    6 days ago


    Anywhere in India/Multiple Locations, IN Gen Full time

    Job Description :Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better...

  • AWS Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN IT Source Global Full time

    We have Immediate Openings on AWS data engineerJob Description :- Data Pipeline Development: Design and develop ETL processes using AWS Glue, Python, and PySpark to extract, transform, and load data from various sources into data lakes or data warehouses.- Data Integration: Integrate data from multiple sources, ensuring data quality, consistency, and...

  • Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations, IN Crescendo Global Full time

    Job Description : Are you an experienced Data Engineer with expertise in Python, Pyspark, and AWS? Our client, a leading technology firm in India, is looking for a Senior Data Engineer to join their team. If you have a strong analytical mindset and a passion for leveraging data to drive business insights, this opportunity is perfect for you.Location : PAN...

  • Lead Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Gen Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for people - we...


  • Anywhere in India/Multiple Locations/Tamil Nadu/Kerala/Andhra Pradesh/Hyderabad/Coimbatore, IN QBrainX Full time

    Role : ServiceNow GRC ConsultantExp level : 4+ yearsJob location : Coimbatore / Hyderabad / Overview :The ServiceNow GRC Consultant will be responsible for implementing and optimizing ServiceNow's GRC modules to support our organization's governance, risk management, and compliance processes. The ideal candidate will have over 4 years of experience...


  • Anywhere in India/Multiple Locations, IN Digihelic Solutions Pvt. Ltd. Full time

    Roles & Responsibilities : - Design, write, test and deploy production-ready code primarily using SAS, Python, and Pyspark. - Be an active member of the technical team, contribute ideas and insight in stand-ups and meetings, ask questions, review pull requests, analyze bugs and fixes, and help users and teammates. - Interface with other technical personnel...


  • Anywhere in India/Multiple Locations, IN SAN Engineering Solutions Full time

    Job Description : Position : Azure Databricks EngineerExperience Level : 5 - 9 YearsLocation : Pan India (Remote Work Available)Job Type : Full-TimeAvailability : Immediate / Early Joiners PreferredAbout the Role :We are seeking a skilled Azure Databricks Engineer to join our dynamic team. The ideal candidate will have extensive experience in Azure services,...

  • Data Engineer

    3 weeks ago


    Hyderabad/Anywhere in India/Multiple Locations, IN Circuit Compilers Full time

    Job Description :- 5 to 8 years in the build release management, software configuration, design, development, and cloud implementation.- Data Engineer with expertise in Python, Scala, PySpark, AWS S3, Glue, Redshift, Lambda, DBT, Serverless, Snowflake, SQL, Datalake, and Data Pipeline.- Leveraged AWS Glue for data cataloging, ETL job orchestration, and...

  • Azure Data Lead

    5 months ago


    Anywhere in India/Multiple Locations, IN Etaash Consulting Full time

    Years of experience : 7 to 15 Years Role : Sr. Tech LeadJob Description :- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in creating...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN IT Source Global Full time

    Role : Data EngineerJob Description :- Design, build, and maintain large-scale data pipelines and ETL/ELT workflows using PySpark, Python, and SQL for data extraction, transformation, and loading.- Work extensively with AWS services such as Amazon S3 for data storage and Athena for querying and analyzing structured and unstructured data.- Develop and manage...


  • Anywhere in India/Multiple Locations/Tamil Nadu/Kerala/Coimbatore/Hyderabad, IN QBrainX Full time

    Role : ServiceNow ITAM ArchitectExp level : 8+ yearsJob location : Coimbatore / Hyderabad / RemoteRole Overview :The ServiceNow ITAM Architect will be responsible for designing and implementing IT Asset Management solutions using the ServiceNow platform. The ideal candidate will have over 8 years of experience in ITAM, with a deep understanding of ServiceNow...

  • Lead Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN ARR Recruitment Solutions Full time

    Job Description :Required skills & experience :- Proficiency in data modeling and database management.- Strong programming skills in Pyspark, Python and SQL.- Experience with ETL (Extract, Transform, Load) processes.- Familiarity with strong data warehousing and Azure cloud platform with immense working knowledge in Databricks. - Knowledge of data governance...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations/Bangalore/Hyderabad/Chennai/Pune/Noida, IN TETRAHED INC Full time

    Role : Data EngineerJob Description :We are looking for a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with specific expertise in Oracle to BigQuery data warehouse migration and modernization. This role requires proficiency in various data engineering...

  • Data Engineer

    3 weeks ago


    Metros/Anywhere in India/Multiple Locations, IN One of the Consulting Firms Full time

    Data Engineer (Python & SQL)Position : Data Engineer (Python & SQL)Locations : Hyderabad, Chennai, Bengaluru, Mumbai, Pune, Kolkata, GurugramJob Type : Full-TimeCompany : Reputed Big 4 MNC client company of Live Connections.Role Overview :We are looking for a skilled Data Engineer with experience in Python, SQL, and Financial Services Industry (FSI) to join...


  • Anywhere in India/Multiple Locations, IN Selsoftinc Full time

    Job Description :We are seeking a seasoned Palantir Data Visualization Engineer and Data Engineer with at least 3 years of expertise in Palantir Foundry tools to lead a team of 6-8 members. The ideal candidate will be responsible for designing, implementing, and leading data integration and security solutions in Palantir, and for providing data-driven...

  • Data Analyst

    3 weeks ago


    Anywhere in India/Multiple Locations/Remote, IN Orangeskill Technologies Pvt Ltd Full time

    Job Title : Data Analyst Location : Remote Experience : 3 - 7 years Job Summary :You will be responsible for providing analytical expertise to the Commercial Organization, driving strategic and operational excellence. This is a hands-on analytical role and as a proactive internal consultant to a specific brand team, the Brand Analytics Analyst will support...

  • Azure Data Engineer

    3 days ago


    Anywhere in India/Multiple Locations, IN estrel.ai Full time

    Job Description :- 5 - 8 years of experience in IT Industry- - 4/5+ years of experience with Azure Data Engineering Stack (Event Hub, Data Factory , Cosmos DB, Synapse, SQL DB, Databricks, Data Explorer) - 3+ years of experience with Python / Pyspark, Spark, Scala, Hive, Impala - Excellent knowledge of SQL and coding skills - Good understanding of other...

  • Application Developer

    3 weeks ago


    Anywhere in India/Multiple Locations/Bangalore/Chennai, IN Nazztec Private Limited Full time

    Summary :As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using PySpark. Your typical day will involve working with the development team, analyzing business requirements, and developing solutions to meet those requirements.Key Responsibilities :-...


  • Anywhere in India/Multiple Locations/Remote/Coimbatore/Hyderabad, IN QBrainX Full time

    Role : ServiceNow ITAM Developer Exp level : 4 -7 Years ExperienceJob Location : RemotePosition Overview : We are looking for an experienced ServiceNow IT Asset Management (ITAM) Developer with 4 to 7 years of experience to enhance and maintain our ITAM solutions within the ServiceNow platform. The ideal candidate will possess strong skills in catalog...