Data Engineer for Scalable Data Platforms
4 days ago
Company Overview
We are a rapidly growing company called Recro, with a focus on data-driven innovation. Our mission is to empower businesses with actionable insights by harnessing the power of data.
About the Role
We are seeking an experienced Senior Data Engineer to join our team in Bengaluru. As a key member of our Data and Business Intelligence organization, you will play a crucial role in designing and building scalable data platforms that fuel strategic business decisions.
Job Responsibilities
- Design and develop highly available, fault-tolerant distributed data processing systems (batch and streaming systems) processing over 100s of terabytes of data ingested every day and petabyte-sized data warehouse and elastic search cluster.
- Build quality data solutions and refine existing diverse datasets to simplified models encouraging self-service.
- Build data pipelines that optimize data quality and are resilient to poor-quality data sources.
- Own the data mapping, business logic, transformations, and data quality.
- Low-level systems debugging, performance measurement, and optimization on large production clusters.
- Participate in architecture discussions, influence product roadmap, and take ownership and responsibility over new projects.
- Maintain and support existing platforms and evolve to newer technology stacks.
Requirements
- Proficiency in Python and pyspark.
- Deep understanding of Apache Spark, Spark tuning, creating RDDs, and building data frames.
- Create Java/ Scala Spark jobs for data transformation and aggregation.
- Experience in big data technologies like HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, Presto, etc.
- Experience in building distributed environments using any of Kafka, Spark, Hive, Hadoop, etc.
- Good understanding of the architecture and functioning of Distributed database systems.
- Experience working with various file formats like Parquet, Avro, etc for large volumes of data.
- Experience with one or more NoSQL databases.
- Experience with AWS, GCP.
- 5+ years of professional experience as a data or software engineer.
What We Offer
We offer a competitive salary range of ₹45 lakhs - ₹60 lakhs per annum, based on your qualifications and experience. Additionally, we provide a comprehensive benefits package, including medical insurance, retirement savings plan, and paid time off.
-
Data Engineering Lead with Scalable Platforms
3 weeks ago
Bengaluru, Karnataka, India HEVO DATA Full timeUnlock Career Growth as a Data Engineering LeadWe're seeking an exceptional Data Engineering Lead to join our team at Hevo Data. In this role, you'll have the opportunity to own and build scalable platform services that support thousands of customers' data pipelines and ensure load data reliability to cloud warehouses.The Hevo platform core services will...
-
Bengaluru, Karnataka, India HEVO DATA Full timeAbout Hevo DataWe empower businesses to drive growth by consolidating data from multiple sources, enabling faster analytics and informed decision making.Mission and VisionOur mission is to build technology that's simple to adopt and easy to access. We aim to unlock the potential of data for everyone.A Day in the Life of a Data Engineer at HevoYou'll work on...
-
Data Engineering Director
3 weeks ago
Bengaluru, Karnataka, India HEVO DATA Full timeEngineering Leadership OpportunityThis is a unique chance to own and build scalable platform services that support thousands of customers' data pipelines, ensuring load data reliability to cloud warehouses.The Hevo platform core services will provide no-code-low pipeline building capabilities, making a significant impact on the company's business.About the...
-
Data Platform Solutions Expert
4 weeks ago
Bengaluru, Karnataka, India HEVO DATA Full timeAbout the RoleWe're seeking a skilled Data Platform Solutions Expert to join our Sales team at HEVO DATA. This is an exciting opportunity for someone with a strong background in Data Domain to work closely with sales professionals, helping them understand customers' business and technical needs and demonstrate how our platform can solve their real-time data...
-
Data Engineer for Scalable Data Platforms
21 hours ago
Bengaluru, Karnataka, India LTIMindtree Full timeWe are seeking an experienced Data Engineer to join our team at LTIMindtree, where you will be responsible for designing and developing scalable data platforms using Spark and Scala.The ideal candidate will have 5+ years of experience in data engineering, with a deep understanding of modern data processing technology stacks, including Spark, HBase, Hive, and...
-
Data Engineer for Scalable Data Platforms
4 weeks ago
Bengaluru, Karnataka, India Luxoft Full timeWe are seeking a skilled Data Operations Engineer to join our team at Luxoft.About the Role:The successful candidate will be responsible for designing, building, and maintaining scalable data collection, storage, and distribution platforms using Snowflake and AWS. This includes developing internal data products and analytics to support systematic &...
-
Data Engineering Manager Lead
3 weeks ago
Bengaluru, Karnataka, India HEVO DATA Full timeScale Data Pipeline Services with HevoWe are seeking an experienced Data Engineering Manager to lead the development of scalable platform services supporting thousands of customers' data pipelines.This role offers a unique opportunity to build and own critical components of our cloud warehouse solution, ensuring reliable data loading and streamlining...
-
Data Platform Engineer
4 weeks ago
Bengaluru, Karnataka, India Stellantis Full timeAbout UsStellantis is a leading global company that has created Mobilisights, a Data-as-a-Service Business Unit. Our vision is to enable a smarter world where innovative applications and services leverage connected vehicle datasets to transform everyday lives.Job DescriptionWe are seeking an experienced Data Platform Engineer to design and build a...
-
Technical Lead for Scalable Data Platforms
4 weeks ago
Bengaluru, Karnataka, India CareerXperts Consulting Full timeCareerXperts Consulting is seeking a highly skilled Technical Lead for Scalable Data Platforms to drive the development of our platform services and database connectors.We are looking for a Senior Engineering Manager to lead and drive the development of highly scalable, fault-tolerant platform services and database connectors that power mission-critical data...
-
Data Architect for Scalable Data Platforms
4 days ago
Bengaluru, Karnataka, India Stellantis Full timeAt Mobilisights, a global company part of Stellantis with 300,000 employees, we're shaping the future of data-driven innovation.We're on a mission to create a smarter world where connected vehicle datasets and insights empower consumers and businesses alike.About the Role:We're seeking an experienced Data Architect to design and build robust, scalable data...
-
Bengaluru, Karnataka, India HEVO DATA Full timeThis role presents a unique opportunity to drive the development and scalability of core platform services at Hevo Data. These services form the foundation of our no-code-low pipeline solution, significantly impacting business growth.As a seasoned engineering leader, you will lead a team of passionate software engineers who pride themselves on ownership and...
-
Data Architect Lead for Scalable Data Platforms
3 weeks ago
Bengaluru, Karnataka, India LinkedIn Full timeJob Description:A talented Data Architect Lead is required to oversee the development and implementation of scalable data platforms at LinkedIn. This high-profile role involves leading a team of engineers in designing, building, and maintaining large-scale data systems that support the company's innovative products.About the Role:This position requires a...
-
Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Gloify Full timeAbout GloifyGloify is a fast-growing technology company that empowers businesses to thrive in the digital age. We're looking for talented professionals like you to join our team and contribute to our mission.Job SummaryWe are seeking an experienced Data Engineer to design, build, and maintain scalable data infrastructure. The ideal candidate should have...
-
Bengaluru, Karnataka, India DataNimbus Full timeAbout DataNimbusDataNimbus is a pioneering organization redefining how businesses leverage data and AI to drive growth, innovation, and efficiency. Our cloud-native ETL designer, comprehensive data and integration platform, and payment modernization platform empower companies to simplify complex workflows, adopt cutting-edge technology, and achieve...
-
Data Architect for Scalable Data Engineering
4 weeks ago
Bengaluru, Karnataka, India Freo Full timeAbout Freo">">Freo is a cutting-edge neobank that is revolutionizing digital banking with an innovative approach tailored to the unique needs of modern consumers in India and SE Asia. With a range of financial products such as a digital savings account, flexible credit lines, credit cards, and EMI cards, buy now pay later (BNPL) schemes, all in one place,...
-
Bengaluru, Karnataka, India Razorpay Full timeWe are looking to hire an experienced Engineering Manager at Razorpay, a leading fintech company, to drive the strategy and execution of complex data initiatives across the organization. As a key member of our team, you will lead a high-performing engineering team to build scalable, low-latency, and fault-tolerant systems.The successful candidate will have...
-
Data Engineer for Scalable Data Infrastructure
1 month ago
Bengaluru, Karnataka, India Aditya Consulting Full timeJob OverviewWe are seeking a highly skilled and experienced Cloud Data Engineer to join Aditya Consulting's dynamic team. The ideal candidate will have a strong background in data engineering with a focus on Google Cloud Platform (GCP) services.About the RoleThe successful candidate will be responsible for designing, building, and maintaining scalable data...
-
Bengaluru, Karnataka, India Groww Full timeAbout GrowwWe are a dedicated team focused on making financial services accessible to every Indian through a cutting-edge, multi-product platform. Every day, we help millions of customers take control of their financial journey.Our team is driven by customer-centricity and a passion to defy conventions and create something extraordinary.We believe that every...
-
Bengaluru, Karnataka, India Wayfair Full timeCompany Overview:At Wayfair, we're revolutionizing the home shopping experience by providing our customers with unparalleled access to a vast array of products. Our commitment to innovation drives us to create seamless, technology-enabled solutions that make every aspect of our business run smoothly.We're seeking an exceptional Senior Software Engineer to...
-
Data Platform Engineer
3 weeks ago
Bengaluru, Karnataka, India Haruto Full timeJob Description:We are seeking a highly skilled Senior Data Platform Engineer to join our team at Haruto. As a key member of our data engineering team, you will play a critical role in designing and developing scalable systems that handle large volumes of batch and real-time data.About the Role:Design and implement both batch and real-time data pipelines in...