QBrainX - Data Engineer - Snowflake/Data Bricks/Python/Pyspark/SQL
2 months ago
Job title - Data Engineer (Mid-Level)
Exp - 3+ to 7 years
Job Location : Coimbatore (Work from Office)
Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you
We are searching for a Mid-Level Data Engineer to join our growing team. In this role, you will play a key part in designing, developing, and maintaining our data pipelines. You will work closely with data scientists, analysts, and business stakeholders to ensure our data infrastructure meets the ever-evolving needs of the :
- Design, develop, and maintain scalable data pipelines using technologies like Python and SQL.
- Develop and implement data quality checks and monitoring processes to ensure data integrity.
- Build and automate data ingestion processes from various sources (databases, APIs, etc.) to Snowflake.
- Utilize cloud platforms (AWS, Azure, GCP) to build and manage data infrastructure.
- Leverage Infrastructure as Code (IaC) tools like Terraform to provision and manage cloud resources.
- Collaborate with data scientists and analysts to understand data requirements and translate them into technical solutions.
- Version control code using Git and collaborate with the team through code reviews.
- Document data pipelines and processes for future reference and knowledge sharing.
Qualifications :
- 3+years of experience in data engineering or a related field.
- Proven experience in designing, developing, and deploying data pipelines.
- Hands on experience with Snowflake or Data Bricks, Python or Pyspark and SQL
- Experience with data warehousing and data modeling concepts.
- Experience working with cloud platforms (AWS, Azure, GCP) is a plus.
- Working knowledge of Terraform and Infrastructure as Code (IaC) principles.
- Experience with Git for version control.
- Excellent communication and collaboration skills.
- Ability to work independently and as part of a team.
- Strong problem-solving and analytical skills.
Bonus Points :
- Experience with data orchestration tools (Airflow, Luigi, etc.).
- Experience with data visualization tools (Tableau, Power BI, etc.)
-
Senior Data Infrastructure Specialist
1 month ago
Kerala/Tamil Nadu/Coimbatore, India QBrainX Full timeJob Title: Senior Data Infrastructure SpecialistAbout the Role:We are seeking a highly skilled Senior Data Infrastructure Specialist to join our team at QBrainX. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines using technologies like Python and SQL.Key...
-
Data Engineering Architect Lead
1 month ago
Coimbatore/Tamil Nadu/Kerala, India QBrainX Full timeLead Data Architect PositionWe are seeking an experienced Data Engineering Architect Lead to join our team at QBrainX.About the RoleThis is a full-time position based in Coimbatore, working from the office. The ideal candidate will have over 10 years of experience in data engineering with a strong focus on architecture.Key Responsibilities:Design and...
-
Anywhere in India/Multiple Locations/Hyderabad/Chennai/Kerala/Andhra Pradesh/Coimbatore QBrainX Full timeJob title - Data Engineering Lead Exp - 6 to 8 years Job Location : Coimbatore / Hyderabad (Work from Office) Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you!We are searching for a Data Engineering Lead to join our growing...
-
Coimbatore/Tamil Nadu/Kerala, India QBrainX Full timeJob Title : Data Engineering Lead / Architect (With Architecture Experience is MUST) Exp level - 10+ years Location : Coimbatore (Work From Office) Position Type : Full-Time Key Responsibilities : Architect and Design Data Solutions : - Collaborate with cross-functional teams to understand business requirements and design scalable and efficient data...
-
Data Engineering Lead
1 month ago
Anywhere in India/Multiple Locations/Hyderabad/Chennai/Kerala/Andhra Pradesh/Coimbatore QBrainX Full timeJob Title: Data Engineering LeadWe are seeking an experienced Data Engineering Lead to join our team at QBrainX. This role involves designing, developing, and maintaining scalable data pipelines using technologies like Python and SQL.About the Role:In this position, you will play a key part in ensuring our data infrastructure meets the ever-evolving needs of...
-
LTIMindtree | Azure Data Engineer
6 days ago
tamil nadu, India LTIMindtree Full timeSkill: ADB+ADF+ Snowflakes +SQL+PYSPARK Experience: 5-10YrsLocation: All LTIM locations:(Pune, Mumbai, Noida, Chennai ,Bangalore ,Hyderabad, Kolkata)JD: (8-12 yrs)Must have skillsMinimum 8 years experience of Data EngineeringExperience in ETLPipeline Development using tools such as Azure DatabricksApache Spark and Azure DataFactory with development...
-
LTIMindtree | Azure Data Engineer
2 weeks ago
tamil nadu, India LTIMindtree Full timeSkill: ADB+ADF+ Snowflakes +SQL+PYSPARKExperience: 5-10YrsLocation: All LTIM locations:(Pune, Mumbai, Noida, Chennai ,Bangalore ,Hyderabad, Kolkata)JD: (8-12 yrs)Must have skillsMinimum 8 years experience of Data EngineeringExperience in ETLPipeline Development using tools such as Azure DatabricksApache Spark and Azure DataFactory with development expertise...
-
Recro | Lead Data Engineer
2 weeks ago
tamil nadu, India Recro Full timeThe tech stack in brief:● Strong experience in Python, Pyspark with SQL● Augmentation of existing ELT pipelines or building new pipelines fromscratch.● Preferred DE cloud exp with Azure synapse, ADLS, ADF and Data bricks.● If not worked with Azure then secondary cloud exp in AWS and Snowflakewill work.● Big Data experience with the Hadoop...
-
Senior Data Engineer
3 weeks ago
Coimbatore, India Cloud Destinations Full timeKey skills :- SQL programming, Snowflake, ETL, AWS or Azure,Python, PysparkRoles & Responsibilities :- Create, maintain, and improve data pipelines for use cases in business operations or analytics.- Work with the team in solving problems in big data technologies and prototype solutionsto improve our data processing architecture.- Works closely with the...
-
Snowflake/Python Developer
1 month ago
Bangalore/Pune/Coimbatore, India Softpath Technologies LLC Full timePreferred Location : Description : - Snowflake + Python(Pandas,Numpy), ETL, SQL - Must have atleast 7+ years of experience in Data warehouse, ETL, BI projects - Must have atleast 5+ years of experience in Snowflake - Expertise in Snowflake architecture is must. - Must have atleast 3+ years of experience and strong hold in Python/PySpark - Must have...
-
Pyspark+databricks
3 months ago
Chennai, Tamil Nadu, India Cognizant Full time**Exp: 4 to 13 years** **Skill: Data Bricks+Pyspark** **Location : Bangalore/Hyderabad/Kolkota/Pune/Chennai** **Technical Skills**: Python,PySpark,Azure Data Lake Store,Databricks Workflows,Databricks SQL **Responsibilities**: - Develop and optimize data solutions using Azure Data Lake Store to support business needs. - Utilize Python to create...
-
Data Analytics
4 months ago
Chennai, Tamil Nadu, India NTT DATA Full time**Must Have**: - Scripting :Python, Pyspark, Unix scripting (Basic) - Cloud : AWS -Lambda, Glue, Athena,RDS,S3, DynamoDB,SNS, SQS, IAM, Step function, Pipeline monitoring, Security, Access and Role permissions, Logging and monitoring Services. - Database : SQL/Oracle - Tools : Pycham,VishualStudio,AWS CLI - Devops Tools : Terraform ,GIT,GIT actions, CICD...
-
Data Analytics
7 months ago
Chennai, Tamil Nadu, India NTT DATA Full timeWe are currently seeking a Data Analytics to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). **Must Have** - Scripting :Python, Pyspark, Unix scripting (Basic) - Cloud : AWS -Lambda, Glue, Athena,RDS,S3, DynamoDB,SNS, SQS, IAM, Step function, Pipeline monitoring, Security, Access and Role permissions, Logging and monitoring Services. Database :...
-
Senior Data Engineer
2 months ago
tamil nadu, India Deloitte Full timeHi, We are looking for Candidates who are having experience in Data Bricks Engineer Along with any cloud experience.Experience Required: 7- 14 YearsLocation: Coimbatore, Tamil Nadu, IndiaResponsibilitiesDesign, develop, and optimize data workflows and notebooks using Databricks to ingest, transform, and load data from various sources into the data lake.Build...
-
Senior Data Engineer
3 months ago
Coimbatore, India Deloitte Full timeHi, We are looking for Candidates who are having experience in Data Bricks Engineer Along with any cloud experience. Experience Required: 7- 14 Year sLocation: Coimbatore, Tamil Nadu, Indi a Responsibiliti esDesign, develop, and optimize data workflows and notebooks using Databricks to ingest, transform, and load data from various sources into the data...
-
tamil nadu, India Tata Consultancy Services Full timeJob Role: Data Engineer | DatabricksJob Location: Chennai/IndoreJob Mode: Work From OfficeExperience Range: Min 5 - 11 yearsDesired Competencies (Technical/Behavioral Competency):- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and Databricks- Highly proficient with Python and PL/SQL, Pyspark-...
-
tamil nadu, India Tata Consultancy Services Full timeJob Role: Data Engineer | Databricks Job Location: Chennai/IndoreJob Mode: Work From OfficeExperience Range: Min 5 - 11 yearsDesired Competencies (Technical/Behavioral Competency):Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and DatabricksHighly proficient with Python and PL/SQL,...
-
Coimbatore, Tamil Nadu, India QBrainX Full timeUnlocking Business Potential with AIAt QBrainX, we're seeking an exceptional Ai Visionary for Strategic Technology Transformation to lead our efforts in harnessing the power of Artificial Intelligence (AI) and Machine Learning (ML) to drive business growth and innovation.About the RoleWe're looking for a highly skilled and experienced professional with a...
-
Hexaware Technologies | Data Engineer
2 weeks ago
tamil nadu, India Hexaware Technologies Full timeDear Candidate,I hope this email finds you well. We are thrilled to announce an exciting opportunity for talented professionals like yourself to join our team as an we are hosting an Open Walk-in Drive in Chennai on 21st Dec (Saturday), 2024.Required Skill: Snowflake + Python & Pyspark.Experience Range: 5 to 9 years.Interview Mode: Face to faceInterview...
-
Deloitte | Senior Data Engineer
6 days ago
tamil nadu, India Deloitte Full timeHi, We are looking for Candidates who are having experience in Data Bricks Engineer Along with any cloud experience.Experience Required: 7- 14 YearsLocation: Coimbatore, Tamil Nadu, IndiaResponsibiliti- esDesign, develop, and optimize data workflows and notebooks using Databricks to ingest, transform, and load data from various sources into the data lak-...