QBrainX - Data Engineering Lead - Python/PySpark
1 month ago
Job title - Data Engineering Lead
Exp - 6 to 8 years
Job Location : Coimbatore / Hyderabad (Work from Office)
Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you
We are searching for a Data Engineering Lead to join our growing team. In this role, you will play a key part in designing, developing, and maintaining our data pipelines. You will work closely with data scientists, analysts, and business stakeholders to ensure our data infrastructure meets the ever-evolving needs of the :
- Design, develop, and maintain scalable data pipelines using technologies like Python and SQL.
- Develop and implement data quality checks and monitoring processes to ensure data integrity.
- Build and automate data ingestion processes from various sources (databases, APIs, etc.) to Snowflake.
- Utilize cloud platforms (AWS, Azure, GCP) to build and manage data infrastructure.
- Leverage Infrastructure as Code (IaC) tools like Terraform to provision and manage cloud resources.
- Collaborate with data scientists and analysts to understand data requirements and translate them into technical solutions.
- Version control code using Git and collaborate with the team through code reviews.
- Document data pipelines and processes for future reference and knowledge sharing.
Qualifications :
- 6 years of experience in data engineering or a related field.
- Proven experience in designing, developing, and deploying data pipelines.
- Hands on experience with Snowflake, DataBricks, Python or Pyspark and SQL.
- Should have experience working in Data Build Tool (DBT) with snowflake is required
- Experience with data warehousing and data modeling concepts.
- Experience working with cloud platforms (AWS, Azure, GCP) is a plus.
- Working knowledge of Terraform and Infrastructure as Code (IaC) principles.
- Experience with Git for version control.
- Excellent communication and collaboration skills.
- Ability to work independently and as part of a team.
- Should have experience in leading the data engineering team.
- Knowledge and Experience toward Architectural and design is added advantage.
- Strong problem-solving and analytical skills.
Bonus Points :
- Experience with data orchestration tools (Airflow, Luigi, etc.).
- Experience with data visualization tools (Tableau, Power BI, etc.)
-
Kerala/Tamil Nadu/Coimbatore, IN QBrainX Full timeJob title - Data Engineer (Mid-Level)Exp - 3+ to 7 yearsJob Location : Coimbatore (Work from Office)Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you!We are searching for a Mid-Level Data Engineer to join our growing team. In...
-
Lead Data Engineer
1 month ago
Anywhere in India/Multiple Locations, IN Gen Full timeJob Description :Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better...
-
AWS Data Engineer
2 months ago
Anywhere in India/Multiple Locations, IN IT Source Global Full timeWe have Immediate Openings on AWS data engineerJob Description :- Data Pipeline Development: Design and develop ETL processes using AWS Glue, Python, and PySpark to extract, transform, and load data from various sources into data lakes or data warehouses.- Data Integration: Integrate data from multiple sources, ensuring data quality, consistency, and...
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations, IN Crescendo Global Full timeJob Description : Are you an experienced Data Engineer with expertise in Python, Pyspark, and AWS? Our client, a leading technology firm in India, is looking for a Senior Data Engineer to join their team. If you have a strong analytical mindset and a passion for leveraging data to drive business insights, this opportunity is perfect for you.Location : PAN...
-
Lead Data Engineer
2 months ago
Anywhere in India/Multiple Locations, IN Gen Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for people - we...
-
DigiHelic - Lead Python Developer - SAS/PySpark
2 months ago
Anywhere in India/Multiple Locations, IN Digihelic Solutions Pvt. Ltd. Full timeRoles & Responsibilities : - Design, write, test and deploy production-ready code primarily using SAS, Python, and Pyspark. - Be an active member of the technical team, contribute ideas and insight in stand-ups and meetings, ask questions, review pull requests, analyze bugs and fixes, and help users and teammates. - Interface with other technical personnel...
-
QBrainX - ServiceNow Test Lead
4 weeks ago
Anywhere in India/Multiple Locations/Remote/Coimbatore/Hyderabad, IN QBrainX Full timeServiceNow Testing LeadExperience Level : 5+ yearsJob Location : RemotePosition Overview :We are looking for a skilled ServiceNow Testing Lead to oversee and enhance our testing processes for ServiceNow implementations. The ideal candidate will have a strong background in ServiceNow testing, quality assurance methodologies, and leadership experience. This...
-
Azure Databricks Engineer
2 months ago
Anywhere in India/Multiple Locations, IN SAN Engineering Solutions Full timeJob Description : Position : Azure Databricks EngineerExperience Level : 5 - 9 YearsLocation : Pan India (Remote Work Available)Job Type : Full-TimeAvailability : Immediate / Early Joiners PreferredAbout the Role :We are seeking a skilled Azure Databricks Engineer to join our dynamic team. The ideal candidate will have extensive experience in Azure services,...
-
Data Engineer
2 months ago
Hyderabad/Anywhere in India/Multiple Locations, IN Circuit Compilers Full timeJob Description :- 5 to 8 years in the build release management, software configuration, design, development, and cloud implementation.- Data Engineer with expertise in Python, Scala, PySpark, AWS S3, Glue, Redshift, Lambda, DBT, Serverless, Snowflake, SQL, Datalake, and Data Pipeline.- Leveraged AWS Glue for data cataloging, ETL job orchestration, and...
-
Azure Data Lead
6 months ago
Anywhere in India/Multiple Locations, IN Etaash Consulting Full timeYears of experience : 7 to 15 Years Role : Sr. Tech LeadJob Description :- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in creating...
-
Data Engineer
2 months ago
Anywhere in India/Multiple Locations, IN IT Source Global Full timeRole : Data EngineerJob Description :- Design, build, and maintain large-scale data pipelines and ETL/ELT workflows using PySpark, Python, and SQL for data extraction, transformation, and loading.- Work extensively with AWS services such as Amazon S3 for data storage and Athena for querying and analyzing structured and unstructured data.- Develop and manage...
-
Lead Data Engineer
2 months ago
Anywhere in India/Multiple Locations, IN ARR Recruitment Solutions Full timeJob Description :Required skills & experience :- Proficiency in data modeling and database management.- Strong programming skills in Pyspark, Python and SQL.- Experience with ETL (Extract, Transform, Load) processes.- Familiarity with strong data warehousing and Azure cloud platform with immense working knowledge in Databricks. - Knowledge of data governance...
-
Data Engineer
2 months ago
Metros/Anywhere in India/Multiple Locations, IN One of the Consulting Firms Full timeData Engineer (Python & SQL)Position : Data Engineer (Python & SQL)Locations : Hyderabad, Chennai, Bengaluru, Mumbai, Pune, Kolkata, GurugramJob Type : Full-TimeCompany : Reputed Big 4 MNC client company of Live Connections.Role Overview :We are looking for a skilled Data Engineer with experience in Python, SQL, and Financial Services Industry (FSI) to join...
-
Data Engineer
2 months ago
Anywhere in India/Multiple Locations/Bangalore/Hyderabad/Chennai/Pune/Noida, IN TETRAHED INC Full timeRole : Data EngineerJob Description :We are looking for a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with specific expertise in Oracle to BigQuery data warehouse migration and modernization. This role requires proficiency in various data engineering...
-
Data Analyst
2 months ago
Anywhere in India/Multiple Locations/Remote, IN Orangeskill Technologies Pvt Ltd Full timeJob Title : Data Analyst Location : Remote Experience : 3 - 7 years Job Summary :You will be responsible for providing analytical expertise to the Commercial Organization, driving strategic and operational excellence. This is a hands-on analytical role and as a proactive internal consultant to a specific brand team, the Brand Analytics Analyst will support...
-
Azure Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations, IN estrel.ai Full timeJob Description :- 5 - 8 years of experience in IT Industry- - 4/5+ years of experience with Azure Data Engineering Stack (Event Hub, Data Factory , Cosmos DB, Synapse, SQL DB, Databricks, Data Explorer) - 3+ years of experience with Python / Pyspark, Spark, Scala, Hive, Impala - Excellent knowledge of SQL and coding skills - Good understanding of other...
-
Data Visualization Engineer
2 months ago
Anywhere in India/Multiple Locations, IN Selsoftinc Full timeJob Description :We are seeking a seasoned Palantir Data Visualization Engineer and Data Engineer with at least 3 years of expertise in Palantir Foundry tools to lead a team of 6-8 members. The ideal candidate will be responsible for designing, implementing, and leading data integration and security solutions in Palantir, and for providing data-driven...
-
QBrainX - ServiceNow ITAM Developer
2 months ago
Anywhere in India/Multiple Locations/Remote/Coimbatore/Hyderabad, IN QBrainX Full timeRole : ServiceNow ITAM Developer Exp level : 4 -7 Years ExperienceJob Location : RemotePosition Overview : We are looking for an experienced ServiceNow IT Asset Management (ITAM) Developer with 4 to 7 years of experience to enhance and maintain our ITAM solutions within the ServiceNow platform. The ideal candidate will possess strong skills in catalog...
-
Databricks Developer
1 month ago
Anywhere in India/Multiple Locations, IN Gen Full timeAbout the Company :Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose the relentless pursuit of a world that works better...
-
Data Engineering Lead/Architect
2 months ago
Coimbatore/Tamil Nadu/Kerala, IN QBrainX Full timeJob Title : Data Engineering Lead / Architect (With Architecture Experience is MUST)Exp level - 10+ yearsLocation : Coimbatore (Work From Office)Position Type : Full-TimeKey Responsibilities :Architect and Design Data Solutions :- Collaborate with cross-functional teams to understand business requirements and design scalable and efficient data solutions.-...