Cloud Data Engineer
5 days ago
Cloud Data Engineer is required - 100% Remote working
IMMEDIATE JOINER REQUIRED
Cloud Data Engineer is required ASAP
With a strong background in AWS, Azure, and GCP the ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc.
You should also have strong experience with Spark and Scala for data processing and have data extraction from SAP / ERP system experience
- You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes.
- Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential.
Key Responsibilities:
Design and Development:
- Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
- Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
- Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.
- Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
- Develop and optimize data processing jobs using Spark Scala.
Data Integration and Management:
- Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.
- Ensure data quality and integrity through rigorous testing and validation.
- Perform data extraction from SAP or ERP systems when necessary.
Performance Optimization:
- Monitor and optimize the performance of data pipelines and ETL processes.
- Implement best practices for data management, including data governance, security, and compliance.
Collaboration and Communication:
- Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Collaborate with cross-functional teams to design and implement data solutions that meet business needs.
Documentation and Maintenance:
- Document technical solutions, processes, and workflows.
- Maintain and troubleshoot existing ETL pipelines and data integrations.
Essential experience must include
- 7+ years of experience as a Data Engineer or in a similar role.
- Proven experience with cloud platforms: AWS, Azure, and GCP.
- Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.
- Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.
- Experience in building and managing data lakes and data warehouses.
- Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.
- Experience with data extraction from SAP or ERP systems is a plus.
- Strong experience with Spark and Scala for data processing.
- Strong programming skills in Python, Java, or Scala.
- Proficient in SQL and query optimization techniques.
- Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts.
- Knowledge of data governance, security, and compliance best practices.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
Preferred Qualifications:
- Experience with other data tools and technologies such as Apache Spark, or Hadoop.
- Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate).
- Experience with CI/CD pipelines and DevOps practices for data engineering
-
Cloud Data Engineer
4 weeks ago
Nellore, Andhra Pradesh, India Birlasoft Full timeAbout BirlasoftWe are a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. Our consultative and design thinking approach drives societal progress by enabling our customers to run businesses with unmatched efficiency and innovation.As part of the CK Birla Group, a multibillion-dollar...
-
Cloud Infrastructure Software Developer
2 weeks ago
Nellore, Andhra Pradesh, India MPC Cloud Consulting Pvt Ltd Full timeMPC Cloud Consulting Pvt Ltd is a leading provider of cloud-based solutions.Salary: ₹12,00,000 - ₹20,00,000 per annumJob Description:Overview: Our company specializes in delivering cutting-edge cloud infrastructure services to our clients.We are looking for: An experienced software developer who can help us build scalable and efficient server-side...
-
Senior AI Engineer
2 weeks ago
Nellore, Andhra Pradesh, India Hyqoo Full timeWe are seeking a highly skilled Senior AI Engineer with expertise in cloud computing and natural language processing to join our team at Hyqoo. This role offers a unique opportunity to design, develop, and deploy cutting-edge AI solutions using the latest technologies and frameworks.Job SummaryThe successful candidate will have 4+ years of hands-on...
-
UI Developer
4 weeks ago
Nellore, India Banyan Cloud Full timeWho are we? About US Banyan Cloud is a US-based Cyber Security Product Development Company, headquartered in San Jose, California, USA. We just launched a SaaS product “Banyan Cloud”, First of its kind Cyber Security Platform, which simplifies the security of multi-cloud and multi tech stack implementation. It's a once-in-a-lifetime opportunity to join...
-
AI/ML Software Engineer
2 weeks ago
Nellore, Andhra Pradesh, India Hyqoo Full timeWe are seeking a skilled AI/ML software engineer to join our team at Hyqoo. As a key member of our development team, you will be responsible for designing and implementing AI solutions using GenAI capabilities.Our ideal candidate will have hands-on experience in Python development with a focus on AI/ML, strong proficiency in ML/DL frameworks such as...
-
Senior Cloud Security Engineer
3 months ago
nellore, India Onclusive Full timeAbout the Role: We are seeking a seasoned Senior Cloud Security Engineer to safeguard our cloud infrastructure across AWS and Azure. The ideal candidate will possess strong knowledge of DevSecOps , Terraform , scripting, and cloud security architecture to deliver secure and scalable solutions. The role will focus on implementing cloud-native security...
-
Software Engineering Team Lead
3 weeks ago
Nellore, Andhra Pradesh, India Cloud First Computing, LLC Full time**Cloud First Computing, LLC** is seeking a highly skilled **Software Engineering Team Lead** to guide and oversee the development of modern web and mobile applications.We value our professionals, providing comprehensive benefits, exciting challenges, and the opportunity for growth. Our ideal candidate will have deep expertise in Spring Boot, React, and...
-
Senior Data Engineer
3 weeks ago
Nellore, India thinkbridge Full timeWe are seeking a skilled Senior Data Engineer with 4-6 years of experience specializing in modern data platforms such as Snowflake, Azure Data Factory (ADF) OR AWS Redshift to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, ensuring the efficient flow of data across the...
-
Cloud-Native Machine Learning Developer
2 weeks ago
Nellore, Andhra Pradesh, India Hyqoo Full timeJob OverviewHyqoo is a leading company in the field of AI and machine learning, and we are currently seeking a Cloud-Native Machine Learning Developer to join our team.The successful candidate will be responsible for designing, developing, and deploying AI and machine learning models for cloud environments, utilizing Azure services and frameworks such as...
-
Data Scientist
2 months ago
Nellore, India Tata Consultancy Services Full timeRole-Data ScientistExp-6-8 yearsLocation-PAN IndiaMust-Have**(Ideally should not be more than 3-5) Strong knowledge in NLP, Gen AI, Deep learning, big data processingStrong experience with SQL and pythonGood-to-HaveSNResponsibility of / Expectations from the Role 3+ years’ experience with SQL and pythonStrong knowledge of machine learning algorithms,...
-
Cloud Solutions Architect
2 months ago
Nellore, India Iyer Analytics Agency Full timeIyer Analytics Agency is on the lookout for a talented Cloud Solutions Architect to elevate our cloud strategy and drive innovation! If you're passionate about designing scalable cloud solutions and have a strong background in cloud architecture, we want to hear from you. Send a connection request to apply and be eligible for application review!Key...
-
Senior Data Engineer
3 months ago
Nellore, India Mindteck Full timeSenior Data Engineer (Scala)Details below:Location: India (WFH)Mode: PermanentMust: Immediate - 30 days 3x headcounts in 10+ yrs band (should be flexible for IST and Europe Time Zone)Salary: INR 24-28 LPAInterview rounds: 2 or 3Job Description:Primarily experts of Spark 3.X, SCALA, Delta lake implementation, streaming solution implementation for IOT in Spark...
-
nellore, India Tekgence Inc Full timeResponsibilities:Effectively Lead Oracle Cloud ERP, EPM, and OTM Deployments and Configurations and drive project deliverablesThis position will be focused on administering key applications Oracle Fusion Cloud ERP & EPM, and OTM throughout their implementation & support lifecycles.Manage Oracle Fusion Cloud ERP application metadata such as provisioning...
-
Full Stack Engineer
2 weeks ago
Nellore, India LuminaData Inc Full timeAbout the Role:LuminaData is an early stage start-up building AI coworkers for Finance teams. Our product is designed to assist finance teams in automating, scheduling, and executing manual tasks such as reconciliation, financial reporting, data aggregation, and analysis.We are seeking a highly skilled Full Stack Engineer with upto 5 years of experience to...
-
PySpark Data Architect Lead
4 days ago
Nellore, Andhra Pradesh, India Edstem Technologies Full timeJob Description:We are seeking a highly skilled Pyspark Data Architect Lead to join our team at Edstem Technologies. As a key member of our data engineering team, you will be responsible for designing and implementing scalable, robust, and efficient data pipelines to enable data-driven decision making.The ideal candidate will have a strong background in data...
-
Full Stack Engineer
4 weeks ago
Nellore, India Community Hub Full timeCommunity Hub creates software products that foster stronger, more sustainable, and more resilient connections among people and the natural systems upon which we depend. Our award-winning communications platform uses sophisticated data acquisition and visualization applications to simplify complexity and share the wisdom of community-focused solutions....
-
Fluidech | Senior DevSecOps Engineer
3 weeks ago
Nellore, India Fluidech Full timeJob Title: Senior DevSecOps Engineer (with Terraform experience)Company Profile:Fluidech is a technology consulting and managed services firm specializing in cloud and on-premise infrastructure, automation (DevOps and RPA), and cybersecurity. Our name, 'Fluidech,' reflects our approach—blending 'fluid' with 'technology' to highlight our adaptable and...
-
Highly Skilled PySpark Data Architect
4 days ago
Nellore, Andhra Pradesh, India Edstem Technologies Full timeAt Edstem Technologies, we are seeking a highly skilled Pyspark Data Architect to join our team. This role is ideal for an experienced data professional who can design and build scalable, efficient data pipelines.Role OverviewThe successful candidate will work collaboratively with the Data Science and Analytics teams to build robust data architectures that...
-
Nellore, Andhra Pradesh, India VivaOps Full timeAt VivaOps, we are seeking a seasoned and innovative DevOps professional to play a pivotal role in shaping and advancing our DevOps practice.We will offer a competitive salary of $140,000 annually, allowing you to excel in your career.About the RoleYou will lead the design, implementation, and evolution of our DevOps solutions, driving excellence,...
-
Credit Data Scientist
4 weeks ago
Nellore, India Discoveries Quintessential Full timeJob Title: Credit Data Scientist & AnalyticsLocation: Jakarta, IndonesiaAbout the RoleJoin an innovative team driving growth by building credit models for groundbreaking products in Southeast Asia. This role involves developing advanced solutions, collaborating across teams, and solving complex problems to create cutting-edge credit products. Ideal for...