Data Platform Engineer
2 weeks ago
Job Title : Data Platform Engineer.
Experience Level : 8+years.
Location : Hyderabad & Bangalore.
Notice Period : 0-15 Days.
Job Description :
- We are seeking a talented Platform Engineer with expertise in Data Mesh/Virtualization technologies to join our dynamic team.
- The ideal candidate will possess a deep understanding of diverse data platforms, emerging technologies, and a proven track record of optimizing data infrastructure for performance and scalability.
Key Responsibilities :
- Utilize expertise in Data Mesh/Virtualization technologies such as Dremio and Starburst to architect and maintain robust data platforms.
- Drive optimization and efficiency through the implementation of distributed file and table formats including Iceberg, Delta, and Apache Parquet.
- Collaborate with cross-functional teams to identify, document, and resolve technical issues and risks.
- Implement and maintain DevOps-related tools such as GIT, Gitlab, Splunk, and Ansible to streamline development and operations processes.
- Ensure adherence to incident management, change management, and problem management processes to minimize service disruptions.
- Develop and maintain scripts using Python and other scripting languages for automation and optimization.
Qualifications :
- Bachelor's degree in Computer Science, Engineering, or related field.
- Strong experience in platform engineering/administration with a focus on Data Mesh/Virtualization technologies.
- Proficiency in distributed file and table formats, Spark, Object Storage (preferably Dell ECS), and metadata management.
- Solid understanding of hardware systems performance and distributed systems architecture.
- Familiarity with major Cloud Service Providers, with MS Azure preferred.
- Proven problem-solving skills and the ability to root-cause technical issues.
- Excellent communication and collaboration skills.
(ref:hirist.tech)
-
Data Platform Engineer
4 weeks ago
Bangalore, Karnataka, India Zyoin group Full timeAbout the Role:We are looking for a skilled and experienced Data Platform Engineer to join our team and play a vital role in designing, developing, and maintaining our data infrastructure. You will leverage your expertise in backend technologies, data processing, and cloud platforms to build robust and scalable solutions for data storage, management, and...
-
Data Engineer
1 month ago
Bangalore, Karnataka, India Intelli Swift Full timeData Engineer - Bangalore (Hybrid) Position : Data Engineer Experience : 7-12 Years Notice Period : less than 15-20 days Mode of Hiring : Permanent Work Location : Bangalore (Hybrid Must Have skills : Data Engineer, GCP, Big Query, Python, SQL, big data. Job Requirement Must Have skills : 1. Designing and implementing data pipelines and infrastructure 2....
-
Senior Data Platform Engineer
1 month ago
Bangalore, Karnataka, India Zyoin group Full timeThe Opportunity :We are seeking a highly skilled and experienced Senior Data Platform Engineer to join our dynamic team. You will play a pivotal role in designing, developing, implementing, and maintaining our data platform that supports large-scale data processing and analytics.Responsibilities :- Design, develop, and maintain scalable and robust data...
-
Principal Data Engineer
1 month ago
Bangalore, Karnataka, India Zyoin group Full timeJob Description :We are looking for Principal Data Engineers to help us build and enhance big data platforms to achieve availability, scalability, and operational effectiveness. The right individual will embrace the opportunity to tackle challenging problems and use their influence to drive continual improvement.You will also work on the cutting edge of...
-
Platform Architect
1 month ago
Bangalore, Karnataka, India Dashhire Full timeWe are seeking a highly skilled and experienced Architect specializing in data platforms to join our team. The ideal candidate will have a proven track record of designing, implementing, and optimizing data platforms with a minimum of 25 TB of data. As an Architect, you will be responsible for leading the design and development of scalable, secure, and...
-
Big Data Engineer
1 month ago
Bangalore/Hyderabad, Karnataka, India VIDPRO CONSULTANCY SERVICES Full timeAbout the job:- This position will be part of a growing team working towards building world class large scale Big Data architectures.- This individual should have a sound understanding of programming principles, experience in programming in Java, Python or similar languages and can expect to spend a majority of their time coding.Location - Bangalore and...
-
Senior/Staff Software Engineer
1 month ago
Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full timeJob Description : - We are looking for a motivated senior technical leader who wants to have a big impact at a fast-growing Platform company.- You'll work on our cloud data platform and the connectors that bring in data from many sources we support.- We're looking for someone who can understand the key values that make our product great and implement...
-
Principal Engineer
1 month ago
Bangalore, Karnataka, India XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full timeWhat Success Will Look Like :- Design, build and maintain the stream processing, time-series analysis system which is at the heart of Data Platform's products- Responsible for architecture of the platform- Build features, enhancements, new services and bug fixing in Scala and Rust on a Jenkins based pipeline to be deployed as Docker containers on...
-
Engineering Manager II
1 month ago
Bangalore, Karnataka, India Intuit Full timeResponsibilities :- Build a new, diverse, and healthy team of engineers for our India development center and coach them to do the best work of their lives.- Embrace new ideas that produce outstanding results for our customers.- In this role you will help to bring out the best ideas from the best engineers by empowering them and leading by example.- Your team...
-
Data Engineer
1 month ago
Bangalore, Karnataka, India Magna Hire Full timeResponsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...
-
Data Architect
1 month ago
Bangalore, Karnataka, India Augmentedresourcing Pvt. Ltd. Full timeData Architect for our MNC Client Based in Bangalore.Job Description :This is a hands-on technology position for a data technology leader with specialized business knowledge in the middle/front office areas. The candidate is someone with a proven record of technology project execution for data on the cloud, able to get hands-on when it comes to analysis...
-
Teradata Platform Engineer
2 weeks ago
Hyderabad/Bangalore, Karnataka, India RapidBraiins Full timeJob Title : Teradata Platform Engineer. Experience level : 8+ years. Location : Hyderabad/ Bangalore. Notice period : 0-30 Days. Job Description :We are looking for a Senior Teradata Database Administrator with expertise in configuring Teradata Database and ecosystem components, troubleshooting complex issues on large Teradata platforms, and driving RCA...
-
Data Engineer
1 day ago
Bangalore, Karnataka, India VY Systems Pvt Ltd. Full timeJob Description : The role described here is for a seasoned data engineer with 8 to 13 years of experience, showcasing proficiency across various aspects of data management and engineering. Let's delve deeper into each requirement :1. Data Engineering Experience :- Candidates should possess a solid foundation in data engineering, indicating a substantial...
-
Meesho - Engineering Manager - Data Platform
7 hours ago
Bangalore, Karnataka, India Meesho Full timeDescription :About the Team :When 5% of Indian households shop with us, it's important to build resilient systems to manage millions of orders every day. We've done this with zero downtime! Sounds impossible? Well, that's the kind of Engineering muscle that has helped Meesho become the e-commerce giant that it is today. We value speed over...
-
Data Engineer
1 month ago
Bangalore/Hyderabad, Karnataka, India Growel Softech Pvt. Ltd. Full timeJob Description :Role : Data EngineerRequired Technical Skills :- More than 5 years' experience implementing data solutions- Strong proficiency in Python with an emphasis in building data pipelines- Experience in big data technologies like HDFS, YARN, Map-Reduce, Kafka, Spark, Airflow, etc.- Experience with Apache Airflow, Google Composer and dataflow-...
-
Wayfair - Senior Product Manager - Data Platform
7 hours ago
Bangalore, Karnataka, India Wayfair Full timeWe are looking for a seasoned Product Manager to accelerate the development of our technology stack. This Product Manager will play a central role in developing our platforms and partnering with a variety of stakeholders in engineering, product, and data science. You will work with them to understand our pain points, our internal business KPIs, and our...
-
Kafka Data Engineer
4 weeks ago
Bangalore, Karnataka, India Codersbrain technology pvt ltd Full timeMandatory skills : - Azure, Kafka, Data Engineering or any Data Platforms background- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes- Terraform (Preferred not Compulsory), Bicep or other IaC.- Helm (helm deployments as well writing charts).- Azure DevOps pipelines.- Engineer, Data Engineer, or similar...
-
Big Data Engineer
1 month ago
Bangalore/Hyderabad, Karnataka, India VIDPRO CONSULTANCY SERVICES Full timeThis position will be part of a growing team working towards building world class large scale Big Data architectures. This individual should have a sound understanding of programming principles, experience in programming in Java, Python or similar languages and can expect to spend a majority of their time coding.Location : Bangalore and HyderabadWork...
-
Data Platform Operations Lead
1 month ago
Bangalore, Karnataka, India Vimerse InfoTech India Pvt Ltd Full timeData Platform Operations Lead (Night Shift) Python Automation Developer Responsibilities for this role:- Provide monitoring, support, and maintenance of Cloud Data Engineering Platform.- Supports global 24x7 operations team in technical support for business operations by proactive. - Overseeing, researching, and resolving production issues in automation...
-
Senior Platform Engineer
1 day ago
Bangalore, Karnataka, India Whizz HR Full timeWe are seeking a highly experienced and motivated Senior Platform Engineer to join our engineering team. The ideal candidate will possess deep expertise in designing, building, and maintaining scalable platform infrastructure. You will be responsible for ensuring the stability, performance, and scalability of our platform, collaborating closely with...