Big Data Engineer
2 weeks ago
We are seeking a highly skilled Data Engineer to join our team at L&T Technology Services. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining large-scale data processing systems on Azure cloud.
The ideal candidate will have 5+ years of hands-on experience in data ingestion, processing, and exploratory analysis using Databricks with Python and SQL. They should also have expertise in parallel and distributed processing, storage, concurrency, and fault-tolerant systems.
In this role, you will work closely with cross-functional teams to build end-to-end data analytics solutions using Azure Data services ADLS, Delta Lake, Delta Live Tables, and Azure Storage. You will also design and deploy CI/CD pipelines using Jenkins and ensure the highest level of quality through unit testing and system integration testing.
Additionally, we require strong skills in Unity Catalog, Delta Sharing, and medallion architecture, as well as prior working experience with high-performance agile teams using Scrum, JIRA, JFrog, and Confluence.
A certification in Azure Data Engineering (DP203) or Databricks is a plus, and experience with IoT data-driven product/platform development environment and medical/healthcare domain expertise are considered desirable.
Key Responsibilities:
- Design and develop large-scale data processing systems on Azure cloud.
- Develop and maintain ETL processes using Databricks with Python and SQL.
- Ensure high-quality data by implementing data validation, error handling, and logging mechanisms.
- Collaborate with cross-functional teams to deliver end-to-end data analytics solutions.
- Design and deploy CI/CD pipelines using Jenkins.
- Implement unit testing and system integration testing using Python frameworks.
Requirements:
- 5+ years of hands-on experience in data engineering.
- Strong skills in Databricks, Python, and SQL.
- Expertise in parallel and distributed processing, storage, concurrency, and fault-tolerant systems.
- Certification in Azure Data Engineering (DP203) or Databricks.
- Prior working experience with high-performance agile teams using Scrum, JIRA, JFrog, and Confluence.
- Strong communication and collaboration skills.
What We Offer:
- A competitive salary of ₹1,200,000 - ₹1,500,000 per annum, based on location and experience.
- A dynamic and challenging work environment.
- Opportunities for career growth and professional development.
- A comprehensive benefits package, including health insurance, retirement savings, and paid time off.
-
Big Data Engineer
4 weeks ago
Bengaluru, Karnataka, India NetAnalytiks Technologies Full timeJob Title: Big Data EngineerWe are seeking an experienced Big Data Engineer to join our team at NetAnalytiks Technologies. As a key member of our data engineering team, you will play a crucial role in designing and implementing large-scale data processing systems.Key Responsibilities:Design and develop scalable data pipelines using Apache Spark and...
-
Big Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full timeJob DescriptionWe are seeking a highly skilled Big Data Engineer to join our team at Coders Brain Technology Private Limited. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying scalable big data pipelines using AWS Databricks.About the RoleDesign, develop, and deploy complex big data pipelines using...
-
Big Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Yuma Full timeJob Title: Big Data EngineerWe are seeking an experienced Big Data Engineer to join our team at Yuma. In this role, you will be responsible for designing and developing batch and streaming solutions using various Big Data technologies.The ideal candidate should have hands-on experience working with Big Data/Analytics technologies like Hadoop, Spark, Python,...
-
Big Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Worksconsultancy Full timeCompany OverviewWe are Worksconsultancy, a leading provider of innovative solutions in the field of data engineering.About the RoleWe are seeking an experienced Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data systems using big data technologies such as Apache Spark,...
-
Big Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Rapture Staffing Full timeAbout Rapture StaffingWe are a staffing company that specializes in placing top talent in data engineering roles. Our team is passionate about helping professionals grow their careers and achieve their goals.Job Description:We are seeking an experienced Big Data Engineer to join our team at Rapture Staffing. The ideal candidate will have a strong background...
-
Big Data Engineer
4 weeks ago
Bengaluru, Karnataka, India QUESS Full timeWe are seeking a highly skilled Big Data Engineer to join our team at QUESS in Bangalore. The estimated salary for this role is ₹1,800,000 - ₹2,400,000 per annum.The ideal candidate will have extensive experience in big data engineering, including building data systems and pipelines, analyzing and organizing raw data, evaluating business needs and...
-
Big Data Engineering Expert
4 weeks ago
Bengaluru, Karnataka, India Grid Dynamics Full timeJob Title: Big Data Engineering ExpertCompany Overview: Grid Dynamics is a leading provider of technology consulting, platform and product engineering, and advanced analytics services. We are seeking an experienced Big Data Engineering Expert to join our team.Job Description: As a Big Data Engineering Expert at Grid Dynamics, you will be responsible for...
-
Big Data Engineer
4 weeks ago
Bengaluru, Karnataka, India HR Consulting Full timeAbout the RoleWe are seeking a skilled Senior Data Engineer to join our team at HR Consulting in Bengaluru. This is an exciting opportunity to work on deep data engineering projects and help define our technical strategy and team culture.This role involves designing and building data platforms and services while managing our data infrastructure in cloud...
-
Big Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Coffeee Full timeAbout CoffeeeCoffeee is a dynamic company that values innovation and collaboration. We're looking for talented professionals to join our team and contribute to the development of cutting-edge big data solutions.Estimated Salary: $120,000 - $180,000 per yearHadoop Developer Job DescriptionWe're seeking an experienced Hadoop developer to join our team and lead...
-
Big Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Idyllic Services Pvt Ltd Full timeJob Title: Big Data EngineerWe are looking for a highly skilled Big Data Engineer to join our team at Idyllic Services Pvt Ltd. In this role, you will design, build, and maintain scalable data pipelines, optimize data processes, and ensure seamless integration of data from various sources.About UsWe are a leading provider of innovative data solutions,...
-
Big Data Engineer Specialist
1 month ago
Bengaluru, Karnataka, India LTIMindtree Full timeLTIMindtree is a global leader in digital transformation consulting and technology services. We are seeking an experienced Big Data Engineer to join our team in Bengaluru, NCR Noida, Gurugram, or Delhi.The ideal candidate will have 5+ years of experience in working with big data technologies such as Pyspark, SQL, and Hive. The role involves designing,...
-
Big Data Engineer
2 days ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeOverviewTata Consultancy Services (TCS) is a global leader in IT services and consulting, with a rich history of innovation and excellence. We are looking for a talented Big Data Engineer - Data Scientist to join our team.Job DescriptionWe are seeking a highly skilled Big Data Engineer - Data Scientist to design and develop high-quality data solutions that...
-
Big Data Engineer
4 days ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeTata Consultancy Services is a leading global consulting and technology services firm that has been at the forefront of digital transformation for over five decades.As a Big Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using Hadoop and related technologies. Your expertise in distributed computing...
-
Big Data Engineering Lead
2 days ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeTata Consultancy Services is seeking an experienced Big Data Engineering Lead to join our team.With a minimum of 8-12 years experience, this individual will be responsible for performing Big Data Administration and Engineering activities on multiple Hadoop, Hbase and Spark clusters.Main Responsibilities:Work on Performance Tuning and Increase Operational...
-
Big Data Engineering Specialist
2 weeks ago
Bengaluru, Karnataka, India Sail Analytics Full time**Job Summary:** Big Data Engineering SpecialistWe are looking for a highly skilled Big Data Engineering Specialist to join our team at Sail Analytics. As a big data engineer, you will be responsible for designing, developing, testing, and maintaining scalable data warehouses and data pipelines using a range of technologies including SQL, Python, and...
-
Big Data Engineering Manager
2 hours ago
Bengaluru, Karnataka, India Sigmoid Full timeSigmoid is a leading provider of big data solutions, and we are seeking an exceptional Technical Lead to join our team. In this role, you will be responsible for building highly scalable and extensible big data platforms that provide the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This position reports...
-
Big Data Engineer Lead
4 weeks ago
Bengaluru, Karnataka, India Powerplay Full time**Job Description**We are looking for an experienced Big Data Engineer Lead to lead our data engineering efforts at Powerplay.The ideal candidate will have a strong background in designing and implementing scalable data architectures, as well as experience with big data tools and technologies.Key Responsibilities:Design and implement large-scale data...
-
Senior Data Engineer
4 weeks ago
Bengaluru, Karnataka, India LinkedIn Full timeAbout the RoleThis role offers a hybrid work option, meaning you can both work from home and commute to an office, depending on what's best for you and your team. As a Senior Data Engineer - Big Data, you will leverage big data to empower business decisions and deliver data-driven insights, metrics, and tools in order to drive member engagement, business...
-
Senior Big Data Cluster Engineer
2 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeAbout the RoleWe are seeking an experienced Senior Big Data Cluster Engineer to join our team at Tata Consultancy Services. This is a critical role that requires strong technical skills, expertise in big data technologies, and experience in leading teams.Key ResponsibilitiesDesign, implement, and manage large-scale Hadoop clusters across multiple...
-
Senior Big Data Engineer
4 weeks ago
Bengaluru, Karnataka, India LTIMindtree Full timeJob Title: Senior Big Data EngineerAbout the Role:We are seeking a skilled Senior Big Data Engineer to join our team at LTIMindtree. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable big data architectures using...