Senior Data Engineer
3 days ago
Job Title : Senior Data EngineerJob Location : BengaluruExp Range : 6-10 yearsNotice Period : immediate - 15 daysWe are looking for Data Engineer with hands on experience on Python , Pyspark , Hadoop Hive, HDFS, Oozie, Yarn Key ResponsibilitiesDesign, develop and maintain large-scale, high-performance data pipelines (batch and streaming) to support analytics and data-driven decision-making for retail business. Collaborate with cross-functional teams (business stakeholders, analysts, platform/infrastructure teams) to understand data needs, ingest diverse data sources, and deliver data solutions. Work on building and evolving a data lake / data warehouse / data platform architecture (including ingestion, transformation, storage, metadata, governance). Implement optimal data models, query tuning, performance optimization, ensuring data quality, reliability, and scalability. Adopt DevOps/CI-CD practices for data workflows (e.g., automated deployments, monitoring, scheduling).Mentor and guide junior engineers, review code/designs, and contribute to architectural decisions and best practices in data engineering. Stay current with new data technologies (cloud data services, streaming frameworks, orchestration) and recommend improvements.Required Skills & ExperienceBachelor’s degree (B.Tech/BE) or equivalent in Computer Science, Engineering, or related.6-10 years of relevant experience in data engineering / big data / analytics platforms.Strong expertise in distributed data processing frameworks such as Apache Spark (Scala or Java) and/or Python.Solid experience with SQL and query optimisation over large volumes of data. Experience with big data ecosystems: Hadoop distributions (Cloudera/Hortonworks), file formats (Parquet/Avro/ORC), streaming frameworks (Kafka, Spark Streaming).Familiarity with data lake/warehouse design, data modelling, metadata management, data quality frameworks. Exposure to cloud data engineering (Azure, AWS, GCP) or hybrid architectures is desirable. Good software engineering practices: code quality, unit/integration testing, version control (Git), CI/CD pipelines, containerisation (Docker/Kubernetes) is a plus. Excellent communication and collaboration skills, ability to work independently and mentor others.
-
Senior DevOps Engineer
4 days ago
bangalore, India Crest Data Full timeCompany Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...
-
Senior DevOps Engineer
5 days ago
bangalore, India Crest Data Full timeCompany Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...
-
Senior DevOps Engineer
3 days ago
bangalore, India Crest Data Full timeCompany Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...
-
Senior DevOps Engineer
5 days ago
bangalore, India Crest Data Full timeCompany Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...
-
Senior Data Engineer
2 weeks ago
bangalore, India AIQU Full timeWe are hiring for Senior Data Engineer to join one of our major clients based out of KSA. Job Details: Role: Senior Data Engineer Work Location: Remote Employment Type: Contract – 12 months & extendable Role Summary: The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power...
-
Senior Data Engineer
1 day ago
bangalore, India Elements HR Services Pvt Ltd Full timeSenior Data Engineer Title Senior Data Engineer Department ISSLocation BengaluruReports To Data Engineers – LeadLevel 4,5,6 We share a commitment to making things better for clients and each other. We continually explore new technology and different ways of working to put our clients first. So, bring your boldest ideas to our (name of team/business area)...
-
Senior Data Engineer
5 days ago
bangalore, India MeghGen Technologies Full timeCompany DescriptionMeghGen Technologies is a trusted technology solutions partner specializing in data engineering, cloud-native applications, and cloud migrations. We design and implement end-to-end cloud solutions to help businesses modernize infrastructure, scale applications, and harness the power of their data. Our expertise extends to AI-powered...
-
Senior Data Engineer
4 days ago
Bangalore, India MeghGen Technologies Full timeCompany Description MeghGen Technologies is a trusted technology solutions partner specializing in data engineering, cloud-native applications, and cloud migrations. We design and implement end-to-end cloud solutions to help businesses modernize infrastructure, scale applications, and harness the power of their data. Our expertise extends to AI-powered...
-
Senior Data Engineer
5 days ago
bangalore, India MeghGen Technologies Full timeCompany Description MeghGen Technologies is a trusted technology solutions partner specializing in data engineering, cloud-native applications, and cloud migrations. We design and implement end-to-end cloud solutions to help businesses modernize infrastructure, scale applications, and harness the power of their data. Our expertise extends to AI-powered...
-
Senior Data Engineer
5 days ago
bangalore, India LogixHealth Full timeJob Title: Senior Data EngineerLocation: Bengaluru/CoimbatoreJob Type: Full-TimeImmediate joiners or notice period of less than 10days are needed.Job Role:As a Senior Data Engineer at LogixHealth, you will work with a globally distributed team of engineers to design and build cutting-edge solutions that directly improve the healthcare industry. You’ll...