▷ [15h Left] Freelance Cloud Data Engineer - AWS, Java, Spark, Ab Initio Expert
2 weeks ago
ThreatXIntel is a startup cyber security company that offers customized, affordable solutions to protect businesses from cyber threats. Specializing in cloud security, web and mobile security testing, and DevSecOps, we aim to provide high-quality services to businesses of all sizes. Our proactive approach involves continuous monitoring and testing to identify vulnerabilities before they can be exploited.
Role Description
We are seeking an experienced Cloud Data Engineer with expertise in AWS, Spark, Java, and Ab Initio graph transformation logic. This role involves working on data migration and transformation for a large-scale cloud data environment, with a focus on converting input data to output files based on transformation requirements. The ideal candidate will also have strong knowledge of parallel and batch processing and experience with Yugabyte data loading.
Key Responsibilities:
- Analyze Ab Initio graph transformations to understand input data structures, transformation logic, and output requirements.- Develop and optimize Java Spark code to transform parquet files and load data into Yugabyte and other storage formats.- Design and implement data migration and integration processes on AWS EMR using Docker and Terraform for deployment.- Collaborate with cross-functional teams to understand data requirements, perform data transformations, and troubleshoot issues.- Ensure high-quality code and efficient performance for data processing pipelines, especially in high-transaction environments.- Document processes, transformations, and code changes, providing technical support during the transition from legacy systems.
Qualifications:
- 5+ years of experience in data engineering, with a focus on AWS, Spark, and Java for cloud-based data migration.- Strong understanding of Ab Initio graph transformations and ability to interpret complex data flows and transformations.- Proficient in AWS EMR and data tools, with experience in Docker and Terraform for infrastructure as code (IaC).- Solid background in parallel processing, batch processing, and handling large transaction volumes.- Knowledge of parquet file formats and loading data into Yugabyte or other distributed databases.- Experience with CI/CD pipelines and familiar with Unix/Linux scripting.- Strong analytical skills and ability to independently troubleshoot and resolve complex data issues.
Preferred Skills:
- AWS Certifications and familiarity with Eclipse IDE and Spring Boot for Java applications.- Experience with orchestration tools like Airflow and containerization with Kubernetes.
Why Join Us?
This is a high-impact role on a core data engineering team, offering the chance to work on cutting-edge cloud technologies and large-scale data migrations. If you have a passion for optimizing data transformations and a strong understanding of cloud-based data systems, we’d love to work with you
-
Freelance Cloud Data Engineer
3 weeks ago
delhi, India ThreatXIntel Full timeCompany Description ThreatXIntel is a startup cyber security company that offers customized, affordable solutions to protect businesses from cyber threats. Specializing in cloud security, web and mobile security testing, and DevSecOps, we aim to provide high-quality services to businesses of all sizes. Our proactive approach involves continuous monitoring...
-
Freelance Cloud Data Engineer
2 weeks ago
delhi, India ThreatXIntel Full timeCompany Description ThreatXIntel is a startup cyber security company that offers customized, affordable solutions to protect businesses from cyber threats. Specializing in cloud security, web and mobile security testing, and DevSecOps, we aim to provide high-quality services to businesses of all sizes. Our proactive approach involves continuous monitoring...
-
Freelance Cloud Data Engineer
3 weeks ago
delhi, India ThreatXIntel Full timeCompany DescriptionThreatXIntel is a startup cyber security company that offers customized, affordable solutions to protect businesses from cyber threats. Specializing in cloud security, web and mobile security testing, and DevSecOps, we aim to provide high-quality services to businesses of all sizes. Our proactive approach involves continuous monitoring and...
-
Freelance Cloud Data Engineer
2 weeks ago
delhi, India ThreatXIntel Full timeCompany DescriptionThreatXIntel is a startup cyber security company that offers customized, affordable solutions to protect businesses from cyber threats. Specializing in cloud security, web and mobile security testing, and DevSecOps, we aim to provide high-quality services to businesses of all sizes. Our proactive approach involves continuous monitoring and...
-
Freelance Cloud Data Engineer
2 weeks ago
Delhi, India ThreatXIntel Full timeCompany DescriptionThreatXIntel is a startup cyber security company that offers customized, affordable solutions to protect businesses from cyber threats. Specializing in cloud security, web and mobile security testing, and DevSecOps, we aim to provide high-quality services to businesses of all sizes. Our proactive approach involves continuous monitoring and...
-
Ab initio developer
5 hours ago
Delhi, India RandomTrees Full timeImmediate #HIRING for a highly motivated and experienced Abinitio Developer to join our growing team.We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies.If you're passionate about building robust applications and thrive in a dynamic...
-
Senior Ab Initio Developer
2 days ago
Delhi, Delhi, India Coffeee Full timeCoffeee is currently seeking a highly skilled Senior Ab Initio Developer to join our team in Bangalore and Chennai. As a Senior Ab Initio Developer, you will play a key role in designing and implementing data engineering solutions using Ab Initio.The ideal candidate should have at least 5 years of relevant experience with Ab Initio, including experience with...
-
Ab Initio Developer
4 weeks ago
Delhi, India Torry Harris Integration Solutions Full timeJob Title -Ab Initio DeveloperJob Location -Bengaluru, Karnataka, IndiaJob DescriptionTorry Harris is a renowned global technology consulting and services company that specializes in cutting-edge integration and API management solutions. In order to meet the growing demand for efficient data integration processes, Torry Harris is seeking a highly skilled Ab...
-
COE Administrator
4 weeks ago
Delhi, Delhi, India Exusia Full timeAbout The PositionDepartment: Sales and Delivery Team - EmpowerIndustry: Information Technology & Services, Computer Software, Management ConsultingExperience Range: 5 to 7 yearsBasic Qualification: Master/Bachelor of Engineering or EquivalentTravel Requirements: NoRole OverviewThis position will be part of our Ab Initio practice and the successful candidate...
-
Ab-initio Developer
1 week ago
Delhi, India Evoke HR Solutions Pvt. Ltd. Full timeJob Opening: Abinitio DeveloperLocation: GurugramExperience Level: 4 - 6 YearsSalary: Up to 15 LPAMust-Have Skills : Ab Initio, GDE, ETLKey ResponsibilitiesAb Initio DevelopmentDesign, develop, test, and deploy high-performance ETL processes using Ab Initio tools and technologies.Data IntegrationsExtract, transform, and load (ETL) data from various...
-
Ab-initio Developer
1 week ago
Delhi, India Evoke HR Solutions Pvt. Ltd. Full timeJob Opening: Abinitio DeveloperLocation:GurugramExperience Level:4 - 6 YearsSalary:Up to 15 LPAMust-Have Skills :Ab Initio, GDE, ETLKey ResponsibilitiesAb Initio DevelopmentDesign, develop, test, and deploy high-performance ETL processes using Ab Initio tools and technologies.Data IntegrationsExtract, transform, and load (ETL) data from various sources into...
-
Senior Ab Initio Platform Engineer
2 weeks ago
Delhi, Delhi, India Exusia Full timeAbout the OpportunityWe are seeking an experienced Senior Ab Initio Platform Engineer to join our team at Exusia, a global technology consulting company.Job OverviewThe successful candidate will be responsible for building and maintaining environments supporting the Ab Initio platform, working with development, training, and support teams to ensure the ETL...
-
Ab Initio COE Specialist
4 weeks ago
Delhi, Delhi, India Exusia Full timeAbout The RoleThis position will be part of our Ab Initio practice and the successful candidate must be able to efficiently communicate with internal teams as well as client personnel in order to deliver industry-leading solutions, detailed functional designs and complex environments throughout the entire lifecycle of the project, leveraging the latest Ab...
-
Ab Initio COE Administrator
6 months ago
Delhi Division, India Exusia Full timeAbout The Position Department: Sales and Delivery Team - Empower Industry: Information Technology & Services, Computer Software, Management Consulting Location: Delhi Experience Range : 5 to 7 years Basic Qualification: Master/Bachelor of Engineering or Equivalent Travel Requirements: No Website : Role Overview This position...
-
Ab Initio Technical Lead
1 month ago
Delhi, Delhi, India Exusia Full timeAbout the RoleThe Ab Initio Technical Lead will be responsible for collaborating with our on-site consultants and off-site teams as a hands-on designer and developer of complex components working on strategic implementation projects using the latest Ab Initio technologies.The candidate must be able to successfully communicate with internal teams as well as...
-
Senior Ab Initio Developer(8+years)_Bangalore
1 month ago
Delhi, India Luxoft Australia Full timeRESPONSIBILITIES- Development, testing, analysis and design applications using AbInitio software products.- Preparation of deployment and configuration scripts within the delivery channel including Production- Troubleshooting and second line support of Production application- Performance tuning and code optimization- Mentoring junior developersEXPERIENCE &...
-
Lead software engineer
6 days ago
Delhi, India Collabera Digital Full timeJob Title :: Lead Developer (Java + Scala/Spark)Location :: India RemoteKey Required Skills :: Spark + Java (Java is a must) and knowledge of ScalaJob Description:1. Create Scala/Spark jobs for data transformation and aggregation2. Produce unit tests for Spark transformations and helper methods3. Write Scala doc-style documentation with all code4. Design...
-
Aws data engineer
2 weeks ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Senior Solution Architect
2 weeks ago
Delhi, India kipi.ai Full time12+ years' of relevant experience, with 3+ years with Snowflake.Success Traits of the Snowflake Solution Architect:- You are an expert with hands-on solution design and development experience- You will be an influencer and thought leader with in-depth technical expertise, credibility, and field experience to establish yourself as a subject-matter expert in a...
-
AWS Data Engineer
3 weeks ago
delhi, India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
