Data Engineer
4 days ago
Mandatory Skills : ETL + Azure Databricks + Python
Roles/Responsibilities:
- Creating testing procedures to evaluate the performance of the data engineering Pipelines
- Building Data validation pipeline that automate testing processes
- Running the Data pipelines testing procedures to evaluate the data pipelines
- Documenting all testing procedures
- Reporting bugs and making recommendations to improve the data pipelines
- Collaborating with other Test Engineers, Software Programmers and other team members
- Retesting data pipelines after bugs are fixed to ensure the pipelines works properly and maintain data quality
Basic Qualifications:
- 4+ years of Python or Java development experience
- 4+ years of SQL experience (No-SQL experience is a plus)
- 4+ years of experience with schema design and dimensional data modelling
- Experience in testing the data processing systems
- Experience working with big data technologies like Hive, Spark etc
- Experience of Google Cloud platform is a plus
- Excellent problem solving and troubleshooting skills
- Process oriented with great documentation skills
-
Data Engineer
5 days ago
Greater Bengaluru Area, India Capgemini Full timeLocation: PAN India Job Description (GCP Data Engineer): • Experience in GCP Data Engineering. • Strong data engineering experience using Java or Python programming languages or Spark on Google Cloud. • Should have worked on handling big data. • Strong communication skills. • experience in Agile methodologies ETL, ELT skills, Data movement...
-
Data Engineer
6 days ago
Greater Bengaluru Area, India Capgemini Full timeLocation: PAN IndiaJob Description (GCP Data Engineer):• Experience in GCP Data Engineering.• Strong data engineering experience using Java or Python programming languages or Spark on Google Cloud.• Should have worked on handling big data.• Strong communication skills.• experience in Agile methodologies ETL, ELT skills, Data movement skills, Data...
-
Data Engineer
1 month ago
Greater Bengaluru Area, India Kratos Gamer Network Full timeAbout KGeN: KGeN (Kratos Gamer Network) is building a multi-chain gamer network that aims to become the home of global gamer data, owned by gamers. At the heart of it is the revolutionary Proof of Gamer (P.O.G) Engine that allows gamers to build, own & monetise their reputation. This data framework allows game publishers to engage with precise gamer...
-
Data Engineer
1 month ago
Greater Bengaluru Area, India Kratos Gamer Network Full timeAbout KGeN:KGeN (Kratos Gamer Network) is building a multi-chain gamer network that aims to become the home of global gamer data, owned by gamers. At the heart of it is the revolutionary Proof of Gamer (P.O.G) Engine that allows gamers to build, own & monetise their reputation. This data framework allows game publishers to engage with precise gamer cohorts,...
-
Azure Data Engineer
4 days ago
Greater Bengaluru Area, India Torry Harris Integration Solutions Full timeAre you an experienced data engineer looking for a new challenge? If so, Torry Harris is seeking a talented Azure Data Engineer to join our team and help drive our data engineering efforts to the next level.As an Azure Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining cloud-based data solutions using Azure...
-
Azure Data Engineer
5 days ago
Greater Bengaluru Area, India Torry Harris Integration Solutions Full timeAre you an experienced data engineer looking for a new challenge? If so, Torry Harris is seeking a talented Azure Data Engineer to join our team and help drive our data engineering efforts to the next level. As an Azure Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining cloud-based data solutions using Azure...
-
Data Engineer
4 weeks ago
Greater Bengaluru Area, India Kunato Full timeWe are seeking a dynamic and driven Data Engineer with a strong blend of technical expertise and business acumen. In this role, you will collaborate with cross-functional teams, including Software Engineers, Data Scientists, Business Analysts, Product Managers, and other key stakeholders, to develop innovative data solutions that fuel business insights and...
-
Data Engineer
4 weeks ago
Greater Bengaluru Area, India Kunato Full timeWe are seeking a dynamic and driven Data Engineer with a strong blend of technical expertise and business acumen. In this role, you will collaborate with cross-functional teams, including Software Engineers, Data Scientists, Business Analysts, Product Managers, and other key stakeholders, to develop innovative data solutions that fuel business insights and...
-
Data Engineer Expert
3 days ago
Greater Bengaluru Area, India LTIMindtree Full timeAbout the RoleWe are seeking a highly skilled Data Engineer Expert to join our team at LTIMindtree.The successful candidate will have a strong background in data engineering and experience with big data technologies like Hive, Spark, and Azure Databricks.Key ResponsibilitiesCreate testing procedures to evaluate the performance of data engineering...
-
Data Engineer
4 weeks ago
Bengaluru, India NTT DATA Full timeJob Description Req ID: 301314 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: As a data...
-
Data Engineer
4 days ago
Greater Bengaluru Area, India DataNimbus Full timeAbout DataNimbus:DataNimbus is a pioneering enterprise and payments modernization company, offeringinnovative solutions to orchestrate financial journeys for businesses worldwide. With anunwavering commitment to unlocking the value of automation and data science toincrease revenue and reduce operational costs and risks, DataNimbus is at the forefront...
-
Data Engineer
2 days ago
Greater Bengaluru Area, India DataNimbus Full timeAbout DataNimbus: DataNimbus is a pioneering enterprise and payments modernization company, offering innovative solutions to orchestrate financial journeys for businesses worldwide. With an unwavering commitment to unlocking the value of automation and data science to increase revenue and reduce operational costs and risks, DataNimbus is at the forefront of...
-
Data Engineer
2 weeks ago
Greater Bengaluru Area, India TerraGiG Full timeRole: Data Engineer Experience: 4-9 years Location: Bangalore Mandatory Skills: Python, PySpark, AWS (must be working in the current project) Job Responsibilities: Extensive hands-on experience in application development using Python , PySpark , and other programming languages. Proficient in building and deploying cloud-native solutions using AWS...
-
Data Engineer
2 weeks ago
Greater Bengaluru Area, India TerraGiG Full timeRole: Data EngineerExperience: 4-9 yearsLocation: BangaloreMandatory Skills: Python, PySpark, AWS (must be working in the current project)Job Responsibilities:Extensive hands-on experience in application development using Python, PySpark, and other programming languages.Proficient in building and deploying cloud-native solutions using AWS services,...
-
Data Engineer
3 months ago
Greater Hyderabad Area, India Circuitry.ai Full timeData Engineer Location: Hyderabad, India - Hybrid Remote (3 days a week in office preferred) Position Overview: As a Data Engineer focused on AI development, you will play a pivotal role in the design, development, and deployment of data infrastructure and pipelines that support artificial intelligence and machine learning initiatives within our...
-
Data Engineer
3 months ago
Greater Hyderabad Area, India Circuitry.ai Full timeData EngineerLocation: Hyderabad, India - Hybrid Remote (3 days a week in office preferred)Position Overview: As a Data Engineer focused on AI development, you will play a pivotal role in the design, development, and deployment of data infrastructure and pipelines that support artificial intelligence and machine learning initiatives within our organization....
-
Senior Data Engineer
1 month ago
Greater Bengaluru Area, India CodeVyasa Full timeLooking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 7+ yrs. of experience. There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...
-
Senior Data Engineer
1 month ago
Greater Bengaluru Area, India CodeVyasa Full timeLooking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 7+ yrs. of experience.There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...
-
Senior Data Engineer
3 weeks ago
Greater Bengaluru Area, India CodeVyasa Full timeLooking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 6+ yrs. of experience.There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...
-
Senior Data Engineer
3 weeks ago
Greater Bengaluru Area, India CodeVyasa Full timeLooking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 6+ yrs. of experience. There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...