Software Developer for Scalable Data Pipelines
21 hours ago
Job Description:
We are seeking a talented Software Developer to join our team at EXL, where you will play a crucial role in designing and building scalable data pipelines for interacting with web-based APIs.
About the Role:
- Develop, implement, and maintain efficient data pipelines for performing CRUD operations on data via GraphQL / RESTful APIs in a seamless and efficient manner.
- Collaborate closely with frontend and backend teams to ensure smooth data integration across systems.
- Design and build scalable API integrations for fetching, processing, and storing data.
- Develop scripts and tools for writing processed data back to the website's APIs, ensuring data consistency, security, and correct API usage.
- Monitor and troubleshoot API integration issues to ensure minimal disruption and high system performance.
- Work closely with data teams to ensure that data fetched via APIs is properly cleaned, transformed, and loaded into internal systems for further analysis.
Requirements:
- Strong experience with GraphQL based API integrations, including CRUD operations.
- Proficiency in programming skills in Python, SQL.
- Excellent understanding of data formats (JSON, XML, CSV) and how to manipulate them for different API interactions
- Familiarity with API testing, error handling, and performance tuning.
- Familiarity in handling authentication mechanisms (e.g., OAuth, API Keys, JWT, etc.) for secure API connections.
PREFERRED SKILLS:
- Familiarity with AWS cloud platforms and their API integration services.
- Experience working with large-scale web data and interacting with third-party APIs.
- Knowledge of data processing frameworks and technologies like Spark.
- Understanding of security practices related to API access and data privacy.
The estimated salary range for this position is between $120,000 and $180,000 per year, depending on location and experience.
-
India Collabera Digital Full timeAbout the RoleWe are seeking a skilled Data Engineer to design, develop, and optimize scalable data transformation and processing pipelines using Scala, Apache Spark, and Java.This role involves collaborating with our data and development teams to build innovative solutions, integrate with various databases, and ensure high-performance data systems.Key...
-
Big Data Engineer: Scalable Solutions Developer
21 hours ago
India ITI Data Full timeWe are seeking an experienced PySpark Data Engineer to join our team at ITI Data. As a key member of our team, you will design and build scalable data solutions for one of our Fortune 500 Client programs.About the Role:The ideal candidate will have extensive experience in working with Hadoop, NoSQL databases, and Spark framework on Python. You will be...
-
Data Engineering Expert
2 weeks ago
India Mphasis Full timeAbout the RoleAt Mphasis, we are seeking a highly skilled Data Engineering Expert - Data Pipeline Developer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines to ingest and transform data from multiple sources using AWS services like S3, Glue, and...
-
AWS Data Pipeline Architect
4 days ago
India FLYONIT Full timeJob DescriptionFlyonit is seeking an experienced AWS Data Pipeline Architect to lead the design and implementation of secure, scalable, and efficient data pipelines on AWS. As a key member of our team, you will be responsible for creating reliable and maintainable data integration solutions using services like Glue, Lambda, Step Functions, and...
-
Data Pipeline Developer
2 days ago
India Tata Consultancy Services Full timeOverviewTata Consultancy Services is a leading IT consulting and business solutions firm that has been at the forefront of innovation for over 50 years.We are seeking an experienced Data Pipeline Developer to join our team in Mumbai, Chennai or Gandhinagar. As a key member of our data engineering team, you will be responsible for designing, implementing and...
-
Senior Java Software Development Expert
21 hours ago
India Java Developer Full timeAbout the RoleWe are seeking a highly skilled and experienced Java Developer to join our team.This is a fantastic opportunity for a talented software engineer to take their career to the next level.The ideal candidate will have a strong background in Java, with experience in developing scalable and efficient software solutions.
-
India ANSR Full timeAbout ANSR: A Leading Life Science Tools and Integrated Systems ProviderAt ANSR, we are dedicated to making genomics useful for all. Our global hub in Bengaluru focuses on technology activities that will help usher in the next wave of innovation in healthcare and medical research. If you're eager to work on challenging projects that use cutting-edge...
-
Software Test Engineer
2 weeks ago
India MSRcosmos LLC Full timeMSR Cosmos Group is currently seeking a skilled Software Test Engineer to join their team on a remote contract basis. This role offers an exciting opportunity for experienced professionals in software testing and data engineering.About MSR Cosmos LLCA reputable company in the industry, MSR Cosmos LLC provides cutting-edge solutions in data management and...
-
Software Engineering Lead for Scalable Systems
21 hours ago
India Initus HR Consulting Pvt-US client Full timeWe are seeking an experienced Software Engineering Lead to lead the development of scalable, high-performance applications using Java, Spring Boot, and modern tech stacks.This role will be critical in designing and implementing robust, distributed systems aligned with microservices architecture, real-time data processing, and cloud deployment strategies.The...
-
Cloud Data Engineering Lead
1 week ago
India ITI Data Full timeITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...
-
India kipi Full timeJob OverviewWe are seeking an experienced Senior Data Architect to lead the development of scalable analytics solutions in Snowflake. The ideal candidate will have 5+ years of experience in data engineering, with expertise in designing and optimizing data pipelines.Main ResponsibilitiesData Pipeline Development: Design, develop, and maintain scalable data...
-
Lead Data Engineer: Strategic Data Architect
4 weeks ago
India Wavicle Data Solutions Full timeWavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...
-
India Hyperion AI Full timeWe are seeking an experienced Data Engineering Lead to join our team at Hyperion AI.As a key member of our engineering organization, you will play a pivotal role in designing, architecting, and leading the development of scalable data processing pipelines using Java and Apache Spark.You will work closely with cross-functional teams to build data-intensive...
-
India Aidetic Full timeWe are seeking an experienced Lead Data Architect to join our team at Aidetic. The successful candidate will have a proven track record of designing and implementing scalable data engineering solutions using Databricks or Snowflake.This role will focus on leading a team of data engineers who are building, maintaining, and optimizing large-scale data...
-
Data Pipeline Specialist
21 hours ago
India TIU Consulting Full timeTIU Consulting is seeking a highly skilled Data Engineer to join our team in Pune.We offer an estimated salary of ₹45,00,000 - ₹75,00,000 per annum, based on experience and qualifications.Job DescriptionAs a Data Engineer at TIU Consulting, you will be part of a cross-functional Scrum team that develops and supports our products. You will work closely...
-
Data Engineer | Build Scalable Data Solutions
3 weeks ago
india HiPaaS Inc. Full timeJob Description: Looking for your next opportunity to make a difference with data? Join our team as a Data Engineer and play a pivotal role in building cutting-edge data infrastructure that drives real business insights. What You Bring to the Table: 5+ years of experience in data modeling and building production-ready data pipelines and transforming data...
-
Data Engineer | Build Scalable Data Solutions
4 weeks ago
India HiPaaS Inc. Full timeJob Description: Looking for your next opportunity to make a difference with data? Join our team as a Data Engineer and play a pivotal role in building cutting-edge data infrastructure that drives real business insights. What You Bring to the Table: 5+ years of experience in data modeling and building production-ready data pipelines and...
-
Data Engineer | Build Scalable Data Solutions
3 weeks ago
India HiPaaS Inc. Full timeJob Description:Looking for your next opportunity to make a difference with data? Join our team as a Data Engineer and play a pivotal role in building cutting-edge data infrastructure that drives real business insights.What You Bring to the Table:5+ years of experience in data modeling and building production-ready data pipelines and transforming data into...
-
Lead data engineer
3 weeks ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
Software Engineering Lead
2 days ago
India California Software Full timeAt California Software, we are seeking a seasoned Software Engineering Lead to spearhead the development of innovative blockchain and AI solutions. With a strong background in leading cross-functional teams, you will drive technical excellence and deliver high-quality products that meet our clients' evolving needs.As a key member of our engineering team, you...