Sr. Data Engineer

3 weeks ago


india SID Information Technologies Full time

#hiring

#Dataengineer


Role: Sr. Data Engineer | Platform Cloud Engineer (Scala / Python with AWS and SQL)

Location: Hyderabad/ Remote/ Hybrid

- For a Healthcare / Genetic Data analytics Client

- For immediate joiners or 30 days Notice Period

- 5+ years of experience


Python Programming OR Scala

SQL / NoSQL

AWS

ETL Pipelines

Redshift

Terraform

Kubernetes

Spark


Job Description:

- Strong background in Scala, or Python Programming Language.

- Build APIs and develop complex data engineering pipelines using Apache Spark and Kafka Streams.

- Build the framework for a cohesive foundational platform that will drive several intelligence and business reports.

- Write unit tests that exercise all major logic components of the code.

- Work directly with stakeholders to understand features, do technical assessments, design, code, test, and ship to production.

- Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, and Scala.

- Analyze, re-architect, and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services.

- Design and implement data engineering, ingestion, and curation functions on AWS cloud using AWS native or custom programming.

- Perform detailed assessments of current state data platforms and create an appropriate transition path to the AWS cloud.


Qualifications:

5+ years of experience developing production software in Java, Scala, Python, or similar languages

3+ years of hands-on experience building custom ETL with a focus on design, data modeling, implementation, and maintenance

3+ years of experience with AWS EMR, Redshift, and Apache Spark

Experience working with AWS Step functions, AWS Glue, or similar technologies


Loc.: Remote | Hyderabad


Share resume with required details (must) : keyuravyas@gmail.com

IMP Note: Only the Application directly sent to email with the following details will receive response immediately.


Required details:

Applied for the position of :

Relevant Skills/Certi. in brief:

Full Name :

Primary Contact Number :

Primary Email ID :

Educational Qualification :

Certification if any :

Current Location:

Current Organization:

Total Experience:

Relevant Exp. :

Current CTC :

Expected CTC :

Offer on Hand Details - If Any :

Immediate Joiner?:

Notice period:

Ready to Relocate to Hyderabad? :

LinkedIn Profile:


Keyura Vyas

Talent Acquisition Manager

Sid Information Technologies



  • india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...


  • india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...

  • Sr. Data Engineer

    3 weeks ago


    india TEKNIKOZ Full time

    Sr. Data EngineerResponsibilities Data Integration, Processing & GovernanceData Storage and Computation Frameworks, Performance OptimizationsAnalytics & VisualizationsInfrastructure & Cloud ComputingData Management PlatformsImplement scalable architectural models for data processing and storageBuild functionality for data ingestion from multiple...


  • India Iitjobs, Inc. Full time

    Greetings!!! Role:- Sr. Data Engineer with GCP and ETL Location- 100 % Remote Duration:5 Months Contract Timing- 1 pm to 10 pm Immediate Joiner Must have skills: 1. GCP - GCS, Pub Sub, Dataflow or Data Proc, Bigquery, Airflow/Composer, Python(preferred)/Java 2. ETL on GCP Cloud - Build pipelines (Python/Java) + Scripting, Best...


  • India iitjobs, Inc. Full time

    Greetings!!! Role:- Sr. Data Engineer with SPARK and Airflow Location- 100 % Remote Duration:4 Months Contract Timing- 1 pm to 10 pm Immediate Joiner Must have skills: 3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects. Good experience on SPARK and Airflow Strong knowledge of relational...


  • India iitjobs, Inc. Full time

    Greetings!!!Role:- Sr. Data Engineer with SPARK and AirflowLocation- 100 % RemoteDuration:4 Months ContractTiming- 1 pm to 10 pmImmediate JoinerMust have skills:3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects.Good experience on SPARK and AirflowStrong knowledge of relational databases like SQL Server, PostgreSQL,...


  • India iitjobs, Inc. Full time

    Greetings!!! Role:- Sr. Data Engineer with SPARK and Airflow Location- 100 % Remote Duration:4 Months Contract Timing- 1 pm to 10 pm Immediate Joiner Must have skills: 3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects. Good experience on SPARK and Airflow Strong knowledge of relational databases like SQL Server,...


  • india iitjobs, Inc. Full time

    Greetings!!! Role:- Sr. Data Engineer with SPARK and Airflow Location- 100 % Remote Duration:4 Months Contract Timing- 1 pm to 10 pm Immediate Joiner Must have skills: 3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects. Good experience on SPARK and Airflow Strong knowledge of relational databases like SQL Server,...


  • India iitjobs, Inc. Full time

    Greetings!!!Role:- Sr. Data Engineer with GCP and ETLLocation- 100 % RemoteDuration:5 Months ContractTiming- 1 pm to 10 pmImmediate JoinerMust have skills:1. GCP - GCS, PubSub, Dataflow or DataProc, Bigquery, Airflow/Composer, Python(preferred)/Java2. ETL on GCP Cloud - Build pipelines (Python/Java) + Scripting, Best Practices, Challenges3. Knowledge of...


  • india iitjobs, Inc. Full time

    Greetings!!! Role:- Sr. Data Engineer with GCP and ETL Location- 100 % Remote Duration:5 Months Contract Timing- 1 pm to 10 pm Immediate Joiner Must have skills: 1. GCP - GCS, PubSub, Dataflow or DataProc, Bigquery, Airflow/Composer, Python(preferred)/Java 2. ETL on GCP Cloud - Build pipelines (Python/Java) + Scripting, Best Practices, Challenges 3....


  • india iitjobs, Inc. Full time

    Greetings!!!Role:- Sr. Data Engineer with GCP and ETLLocation- 100 % RemoteDuration:5 Months ContractTiming- 1 pm to 10 pmImmediate JoinerMust have skills:1. GCP - GCS, PubSub, Dataflow or DataProc, Bigquery, Airflow/Composer, Python(preferred)/Java2. ETL on GCP Cloud - Build pipelines (Python/Java) + Scripting, Best Practices, Challenges3. Knowledge of...


  • India iitjobs, Inc. Full time

    Greetings!!! Role:- Sr. Data Engineer with GCP and ETL Location- 100 % Remote Duration:5 Months Contract Timing- 1 pm to 10 pm Immediate Joiner Must have skills: 1. GCP - GCS, PubSub, Dataflow or DataProc, Bigquery, Airflow/Composer, Python(preferred)/Java 2. ETL on GCP Cloud - Build pipelines (Python/Java) + Scripting, Best Practices, Challenges 3....


  • india TEKNIKOZ Full time

    Sr. Data Engineer Responsibilities Data Integration, Processing & Governance Data Storage and Computation Frameworks, Performance Optimizations Analytics & Visualizations Infrastructure & Cloud Computing Data Management Platforms Implement scalable architectural models for data processing and storage Build functionality for data ingestion from multiple...

  • Sr. ml engineer

    1 month ago


    India TribolaTech Inc Full time

    Remote Role Permanent position Job Title: Sr. ML Engineer Required Looking for a ML engineer with 12+ years overall experience with strong ML experience background to help us build robust data driven solution which can help us advance our predictive analytics capabilities. Langchain Lang Graph AWS Finetuning LLM Multi Agents Advance Ra G...

  • Sr. ML Engineer

    1 month ago


    India TribolaTech Inc Full time

    Remote Role Permanent position Job Title: Sr. ML Engineer Required Looking for a ML engineer with 12+ years overall experience with strong ML experience background to help us build robust data driven solution which can help us advance our predictive analytics capabilities. Langchain LangGraph AWS Finetuning LLM Multi Agents Advance RaG Systems ...

  • Scala Data Engineer

    7 days ago


    India Essvee Consultant Full time

    Profile : Scala Data Engineer / Sr. Data Engineer | Location: Mumbai | Experience: 5 or 5+ years | Budget : 10 to 15lac | Hybrid Job | Note: If you want your CV shortlisted, Copy, Paste and fill out the below form for a better response. Scala Data Engineer / Sr. Data Engineer Skills: Spark, Data Bricks, Azure, Azure Data, SQL, Services,...

  • Lead data engineer

    6 days ago


    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Sr. ml engineer

    2 weeks ago


    India TribolaTech Inc Full time

    Remote Role Permanent position Job Title: Sr. ML Engineer Tribola Tech Founded in 2009, Tribola Tech specializes in providing Information Technology Solutions and Outsourcing Services. Our executive teams have over 5 decades of combined experience in IT Consulting, Data Management and Staff Augmentation. We love technology and are proud to...

  • Sr. Data Engineer

    3 weeks ago


    India SID Information Technologies Full time

    #hiring #Dataengineer Role:  Sr. Data Engineer | Platform Cloud Engineer (Scala / Python with AWS and SQL) Location:  Hyderabad/ Remote/ Hybrid - For a Healthcare / Genetic Data analytics Client - For  immediate joiners or 30 days Notice Period - 5+ years of experience Python Programming OR Scala SQL / NoSQL AWS ETL Pipelines ...