(Only 24h Left) Big Data Engineer with Devops
2 weeks ago
Exp - 6-10 Yrs
Job Location- Bangalore ( 3 days hybrid working )
Job Description
As a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced data pipeline designer and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will lead our software developers on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.
Responsibilities
- Create and maintain optimal data pipeline architecture- Assemble large complex data sets that meet functional / non-functional business requirements.- Identify design and implement internal process improvements: automating manual processes optimizing data delivery, coordinating to re-design infrastructure for greater scalability etc.- Work with stakeholders including the Executive Product Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.- Keep our data separated and secure- Work with data and analytics experts to strive for greater functionality in our data systems.- Support PROD systems
Qualifications
- Must have About 6 - 11 years and at least 3 years relevant experience with Bigdata.- Must have Experience in building highly scalable business applications, which involve implementing large complex business flows and dealing with huge amount of data.- Must have experience in Hadoop, Hive, Spark with Scala with good experience in performance tuning and debugging issues.- Hands-on experience in one of the cloud provider (AWS/Azure) is must- Good to have any stream processing Spark/Java Kafka.- Must have experience in design and development of Big data projects.- Good knowledge in Functional programming and OOP concepts, SOLID principles, design patterns for developing scalable applications.- Familiarity with build tools like Maven.- Must have experience with any RDBMS and at least one NoSQL database preferably PostgresSQL- Must have experience writing unit and integration tests using scaliest- Must have experience using any versioning control system - Git- Must have experience with CI / CD pipeline – Jenkins is a plus- Databricks Spark certification is a plus.
-
Data Engineer
3 weeks ago
Bengaluru, India Tech Mahindra Full timeTech Mahindra is #hiring for GCP Data Engineer .If you're an experienced professional looking for an exciting new challenge.We want to hear from you! Please apply to with your resume explaining your experience and qualifications.Location: Pan IndiaGCP Data Engineer : U2 – up to 3 yearsPrimary Skill : Big Querry, Data flow, Data Composer, SQL, Python.•...
-
Big data engineer with devops
2 weeks ago
Bengaluru, India Damco Solutions Full timePosition – Big Data Engineer with DevopsExp - 6-10 YrsJob Location- Bangalore ( 3 days hybrid working )Job DescriptionAs a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced...
-
▷ (Only 24h Left) Senior Big Data Developer
1 month ago
Bengaluru, India IntraEdge Full timeWe are looking for a highly skilled Senior Big Data Developer to join our engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to architect scalable data pipelines and provide valuable insights through advanced data...
-
Big Data Engineer with Devops
2 weeks ago
Bengaluru, India Damco Solutions Full timePosition – Big Data Engineer with DevopsExp - 6-10 YrsJob Location- Bangalore ( 3 days hybrid working )Job DescriptionAs a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced...
-
Big Data Engineer with Devops
2 weeks ago
Bengaluru, India Damco Solutions Full timePosition – Big Data Engineer with Devops Exp - 6-10 Yrs Job Location- Bangalore ( 3 days hybrid working ) Job Description As a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an...
-
Big Data Engineer with Devops
2 weeks ago
Bengaluru, India Damco Solutions Full timePosition – Big Data Engineer with DevopsExp - 6-10 YrsJob Location- Bangalore ( 3 days hybrid working )Job DescriptionAs a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced...
-
Big Data Engineer with Devops Expert
2 weeks ago
Bengaluru, Karnataka, India Damco Solutions Full timeAt Damco Solutions, we're seeking a highly skilled Big Data Engineer with Devops expertise to join our team.We offer an attractive salary of approximately ₹25,00,000 - ₹40,00,000 per annum, depending on experience and qualifications.Job Description:The ideal candidate will have about 6-11 years of experience in building highly scalable business...
-
Senior Data Engineer
4 weeks ago
Bengaluru, Karnataka, India DevOn Full timeDevOn is a dynamic company that values innovation and employee growth. As a Senior Data Engineer on our Big Data Operations team, you will play a crucial role in shaping the future of data management.Job DescriptionWe are seeking an experienced Senior Data Engineer to join our team. In this role, you will be responsible for designing and implementing...
-
Big Data Engineer
5 months ago
Bengaluru, India Telescopp Full timeJob OverviewWe are looking for a talented Big Data Engineer to join our team in Bengaluru. This is a mid-level, full-time position requiring a minimum of 4 years to a maximum of 6 years of relevant work experience. As a Big Data Engineer at Telescopp, you will be responsible for developing, testing, and maintaining big data solutions to support our client's...
-
▷ Only 24h Left: DevOps Engineer
5 days ago
Bengaluru, India Tata Consultancy Services Full timeSkill:: Devops ENgineerLocation::BangaloreExperience: 5 to 8 YearsJob Description:- Provide DevOps, build and release, and CI/CD expertise to agile teams IaaC development teams- Execute the available IAC automation scripts and provide feed backs in case of failures.- Apply the fixes / follow the standard operating procedures to mitigate the failures.- Work...
-
Senior Manager-Data
6 days ago
Bengaluru, India Cardinal Health Full timeJob overviewData & Platform Engineering Lead will be responsible for managing and maintaining multiple teams focused on Platform Engineering and Data Ingestion Operation.The Manager applies Software Engineering, and DevOps practices to guide the team in maintaining large-scale enterprise data platform supporting Analytics and Machine Learning solutions...
-
[Only 24h Left] Azure Data Engineer
3 weeks ago
Bengaluru, India Xebia Full timeFounded in 2001, Xebia was the first Dutch organization to embrace the Agile way of working, with gurus like Jeff Sutherland. Since then, we have grown from a Java company into a full-service digital consulting company with 5,000 professionals working on a worldwide ambition.We are organized in complementary chapters – teams with a tremendous amount of...
-
Data Engineer for Big Data Pipelines
5 days ago
Bengaluru, Karnataka, India AppSierra Solutions Pvt Ltd Full timeWe are seeking a seasoned data engineer to lead the development and deployment of big data pipelines using AWS DataBricks.With 5-7 years of experience in software development on AWS, you will have strong hands-on knowledge of AWS DataBricks, DevOps, Kubernetes, and cloud services such as S3, Redshift, EC2, and Lambda. Additionally, you will have extensive...
-
[Only 24h Left] Sr Devops
7 days ago
Bengaluru, India ITC Infotech Full timeInterested candidates can share your resumes to along with Requested details below.Note: whoever is sharing the updated Profile/Resume along with the below details those application will be taken ahead.Skill:Candidate Name:Candidate Mobile Number:Email ID:Gender:Current Company:Total Experience in Years:Relevant Experience in Years:Current Location:Work...
-
[Only 24h Left] Senior Data Engineer
1 month ago
Bengaluru, India Giant Eagle GCC Full timeSenior Data EngineerGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s largest food retailers...
-
Big Data Engineering Lead
4 weeks ago
Bengaluru, Karnataka, India Altimetrik Full timeJob DescriptionWe are seeking an experienced Big Data Engineering Lead to join our team at Altimetrik. In this role, you will be responsible for overseeing the development and maintenance of reliable and scalable ETL pipelines on big data/cloud platforms.As a key member of our team, you will collaborate with other teams to design, develop, and deploy data...
-
▷ (Only 24h Left) GCP Data Lead
4 weeks ago
Bengaluru, India Cygnus Professionals Inc. Full timeRole: Google Cloud Platform (GCP) Data LeadLocation: Bangalore, India (Day 1 Onsite)Job Type: ContractJob Description:- Strong GCP experience- Prior experience in building pipelines using dataflow, data fusion, data proc, etc- Very strong python coding skill- Experience in optimising GCP resources for cost and performance- Experience in containerisation of...
-
▷ (Only 24h Left) Azure Databricks Engineer
2 weeks ago
Bengaluru, India krtrimaIQ Cognitive Solutions Full timeJob Title: Azure Databricks EngineerLocation: BangaloreExperience Level: 5+ years of relevant experienceEmployment Type: Full-TimeAbout Us:Join our team to help shape the future of data solutions! We are looking for a skilled Azure Data Engineer to work on cutting-edge projects, transforming large-scale data and enabling data-driven insights for our clients....
-
Big Data Engineer with Devops
2 weeks ago
Bengaluru, India Damco Solutions Full timePosition – Big Data Engineer with DevopsExp - 6-10 YrsJob Location- Bangalore ( 3 days hybrid working )Job DescriptionAs a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced...
-
Data Engineer
2 months ago
Bengaluru, India Coders Brain Technology Private Limited Full timeQualifications : - Bachelor's degree in Computer Science/Engineering or similar - 5-7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines - Proficiency with Cloud Platforms like Azure(preferred), AWS, and/or Google cloud, including knowledge of core services like Azure: Data...