Current jobs related to Ab Initio to Spark Migration Developer - pune - EXL

  • Senior Ab Initio and Spark Developer

    4 weeks ago

    Pune, Maharashtra, India Synechron Full time

    About the RoleWe are seeking a highly skilled Senior Ab Initio and Spark Developer to lead the design and development of complex data processing applications within our organization.As a key member of our data engineering team, you will be responsible for leveraging the strengths of both Ab Initio and Apache Spark to deliver scalable and performance-driven...

  • Ab Initio and Apache Spark Developer

    2 weeks ago

    Pune, Maharashtra, India Synechron Full time

    About the RoleWe are seeking a highly skilled Ab Initio and Apache Spark Developer to join our team. The ideal candidate will have a strong background in big data processing and a proven track record of delivering scalable and performance-driven solutions.Key Responsibilities:Lead architectural design sessions and technical reviews to create a robust,...

  • Ab Initio Developer

    4 weeks ago

    Pune, Maharashtra, India Synechron Full time

    About the RoleWe are seeking a highly skilled Senior Ab Initio and Spark Developer to lead the design and development of complex data processing applications within our organization.As a key member of our data engineering team, you will be responsible for leveraging the strengths of both Ab Initio and Apache Spark to deliver scalable and performance-driven...

  • Ab initio developer

    4 weeks ago

    Pune, India Synechron Full time

    Good-day, We have immediate opportunity for Ab Initio Developer. Job Role: Ab Initio Developer Job Location: Bangalore BCIT/ Pune Experience- 7 to 10years Notice : upto 15 Days. About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative...

  • Ab initio developer

    1 week ago

    Pune H.o, India Synechron Full time

    Good-day, We have immediate opportunity for Ab Initio Developer. Job Role: Ab Initio Developer Job Location: Bangalore BCIT/ Pune Experience- 7 to 10years Notice : upto 15 Days. About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to...

  • Ab Initio Developer

    4 weeks ago

    Pune, Maharashtra, India TransUnion LLC Full time

    About the Role:We are seeking a highly skilled Ab Initio Developer to join our team at TransUnion LLC. As a key member of our development team, you will be responsible for designing, developing, testing, and supporting data processing applications, internal platforms, and customized solutions using Ab Initio and other data management tools.Key...

  • Ab initio Developer

    4 weeks ago

    Pune, India Synechron Full time

    Good-day, We have immediate opportunity for AbInitio Developer. Job Role: AbInitio Developer Job Location: Bangalore BCIT/ Pune Experience- 7 to 10years Notice : upto 15 Days . About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative...

  • Ab initio Developer

    4 weeks ago

    pune, India Synechron Full time

    Good-day,We have immediate opportunity for AbInitio Developer.Job Role: AbInitio DeveloperJob Location: Bangalore BCIT/ PuneExperience- 7 to 10yearsNotice : upto 15 Days .About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver...

  • Ab initio Developer

    1 week ago

    pune, India Synechron Full time

    Good-day,We have immediate opportunity for AbInitio Developer.Job Role: AbInitio DeveloperJob Location: Bangalore BCIT/ PuneExperience- 7 to 10yearsNotice : upto 15 Days .About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver...

  • Ab initio Developer

    3 weeks ago

    pune, India Synechron Full time

    Good-day, We have immediate opportunity for AbInitio Developer. Job Role: AbInitio Developer Job Location: Bangalore BCIT/ Pune Experience- 7 to 10years Notice : upto 15 Days . About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology...

  • Ab Initio Architect

    3 weeks ago

    pune, India GIOS Technology Full time

    Hi Hope you are doing great,I have Job opening for "Ab-initio architect" for one of our client engagements interested candidates can apply,Ab-initio architectPune, Maharashtra(Onsite)Responsibilities:• Requirements Analysis: Collaborate with business stakeholders to understand data integration requirements and translate them into technical solutions using...

  • Ab Initio Architect

    3 weeks ago

    Pune, India GIOS Technology Full time

    Hi Hope you are doing great, I have Job opening for "Ab-initio architect" for one of our client engagements interested candidates can apply, Ab-initio architect Pune, Maharashtra(Onsite) Responsibilities: • Requirements Analysis: Collaborate with business stakeholders to understand data integration requirements and translate them into technical...

  • Ab Initio Architect

    3 weeks ago

    Pune, Maharashtra, India GIOS Technology Full time

    About the RoleWe are seeking a highly skilled Ab Initio Architect to join our team at GIOS Technology. As an Ab Initio Architect, you will be responsible for designing and developing data integration solutions using Ab Initio GDE.Key ResponsibilitiesCollaborate with business stakeholders to understand data integration requirements and translate them into...

  • Ab Initio Architect

    3 weeks ago

    Pune, India GIOS Technology Full time

    Hi Hope you are doing great,I have Job opening for "Ab-initio architect" for one of our client engagements interested candidates can apply,Ab-initio architectPune, Maharashtra(Onsite)Responsibilities:• Requirements Analysis: Collaborate with business stakeholders to understand data integration requirements and translate them into technical solutions using...

  • Ab Initio Architect

    3 weeks ago

    Pune, India GIOS Technology Full time

    Hi Hope you are doing great, I have Job opening for "Ab-initio architect" for one of our client engagements interested candidates can apply, Ab-initio architect Pune, Maharashtra(Onsite) Responsibilities: • Requirements Analysis: Collaborate with business stakeholders to understand data integration requirements and translate them into technical...

  • Ab Initio Architect

    3 weeks ago

    Pune, India GIOS Technology Full time

    Hi Hope you are doing great,I have Job opening for "Ab-initio architect" for one of our client engagements interested candidates can apply,Ab-initio architectPune, Maharashtra(Onsite)Responsibilities:• Requirements Analysis: Collaborate with business stakeholders to understand data integration requirements and translate them into technical solutions using...

  • Ab Initio Architect

    3 weeks ago

    pune, India GIOS Technology Full time

    Hi Hope you are doing great,I have Job opening for "Ab-initio architect" for one of our client engagements interested candidates can apply,Ab-initio architectPune, Maharashtra(Onsite)Responsibilities:• Requirements Analysis: Collaborate with business stakeholders to understand data integration requirements and translate them into technical solutions using...

  • Ab Initio Architect

    3 weeks ago

    Pune, India GIOS Technology Full time

    Hi Hope you are doing great,I have Job opening for "Ab-initio architect" for one of our client engagements interested candidates can apply,Ab-initio architectPune, Maharashtra(Onsite)Responsibilities:• Requirements Analysis: Collaborate with business stakeholders to understand data integration requirements and translate them into technical solutions using...

  • Ab Initio Architect

    3 weeks ago

    Pune H.O, India GIOS Technology Full time

    Hi Hope you are doing great,I have Job opening for "Ab-initio architect" for one of our client engagements interested candidates can apply,Ab-initio architectPune, Maharashtra(Onsite)Responsibilities:-Requirements Analysis: Collaborate with business stakeholders to understand data integration requirements and translate them into technical solutions using Ab...

  • Ab Initio Cloud COE Administrator

    4 weeks ago

    Pune, Maharashtra, India Exusia Full time

    About the PositionExusia, a global technology consulting company, is seeking a highly skilled Ab Initio Cloud COE Administrator to join our team. As a key member of our cloud computing team, you will be responsible for designing, implementing, and maintaining Ab Initio cloud-based solutions.Key ResponsibilitiesDesign and implement Ab Initio cloud-based...

Ab Initio to Spark Migration Developer

2 months ago

pune, India EXL Full time

Position - Ab Initio to Spark Migration Expert

Location - Pune/Bangalore/Gurgaon (Hybrid)

Experience - 4+


We are seeking a skilled Ab Initio to Spark Migration Developer to facilitate our transition from Ab Initio ETL processes to a Spark-based framework. This critical role involves analyzing existing workflows, designing scalable data architectures, and developing high-performance applications using Spark and Scala. You will collaborate closely with cross-functional teams to ensure data solutions meet business needs while also optimizing performance and automating processes. In addition to technical migration, you'll mentor junior team members and promote best practices. Your ability to communicate complex concepts to non-technical stakeholders will be essential for driving successful outcomes in our data initiatives.


Key Responsibilities:

  • Migration : Transition existing ETL processes from Ab Initio to Spark, ensuring a smooth process with minimal disruption to operations.
  • Architecture Design : Collaborate with data architects to design scalable and efficient data processing architectures that meet business requirements.
  • Data Processing Development : Develop high-performance applications using Spark and Scala, implementing best practices in coding and architecture.
  • SQL Proficiency : Utilize strong SQL skills to query and manipulate data stored in Oracle databases as part of the migration and development process.
  • Performance Optimization : Identify and implement strategies for optimizing Spark applications to enhance performance and resource utilization.
  • Automation : Create and maintain shell scripts to automate various ETL tasks and streamline workflows.
  • Workflow Orchestration : Use Apache Airflow to schedule, monitor, and manage data pipelines, ensuring reliable data flow.
  • Debugging and Troubleshooting : Proactively debug and resolve issues in Spark applications, employing analytical skills to identify and fix problems effectively.
  • Documentation : Maintain comprehensive documentation of processes, workflows, and configurations for future reference and knowledge sharing.
  • Collaboration : Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to align on data requirements and project objectives.
  • Continuous Improvement : Stay informed on industry trends, tools, and best practices related to ETL, big data, and cloud technologies, and recommend enhancements as needed.


Must-Have Skills:

  • Ab Initio ETL : Extensive experience with Ab Initio, including deep understanding of XFR (Components, Graphs, and Plans).
  • Spark & Scala : Strong proficiency in developing applications using Spark and Scala is mandatory.
  • SQL & Oracle : Solid experience in SQL and familiarity with Oracle databases, including data querying and manipulation.
  • Performance Optimization : Proven ability to analyze and optimize Spark applications for performance, including resource management.
  • Shell Scripting : Strong skills in writing and managing shell scripts for automation and process management.
  • Airflow : Proficiency in Apache Airflow for orchestrating complex data workflows and ensuring reliability.
  • Debugging Skills : Excellent debugging and problem-solving skills to troubleshoot and resolve issues promptly.
  • Version Control : Experience with GIT and Jenkins for version control and continuous integration processes.


Good-to-Have Skills:

  • Cloudera Data Platform : Understanding of Cloudera Data Platform and its integration with big data technologies.
  • Cloud Platforms : Familiarity with cloud data services such as AWS, Azure, or GCP, including tools like AWS Glue or Azure Data Factory.
  • Data Warehousing : Knowledge of data warehousing concepts and methodologies.
  • Big Data Technologies : Understanding of other big data technologies (e.g., Hadoop, Hive, Kafka).
  • Data Modeling : Experience in data modeling and database design, especially in big data contexts.
  • Agile Methodologies : Previous experience working in Agile/Scrum environments.


Qualifications:

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • 5-7 years of experience in data engineering or ETL development, with a focus on migration projects.
  • Proven track record of successful migration projects from Ab Initio to Spark using Scala.