Big Data Specialist

4 weeks ago

Nagpur, India Taggd Full time

Position: Senior Cloud Data Engineer – AWS & Big Data

Location: Nagpur/Pune

Experience: 7 to 9 years

Notice Period: 30 Days

Travel: Not required however the candidate is supposed to work with global teams in a remote environment

Compensation : 26 Lacs Annually [(This is the fixed compensation for this role. Candidates with salary expectations exceeding this amount are kindly requested not to apply.]


Type of Employment: Full-time


Purpose of the Position:

You will be a critical member of Our Client in Cloud Data Development Team.

This position requires a sound knowledge on Big Data using Cloud technologies, EMR, Athena, Spark-Scala,

PySpark, S3, AWS Lambda.

Strong foundation on database concepts and SQL is also required.

Our client is a global leader of end-to-end data and analytics solutions with nearly 20 years’ experience enabling customers to derive value from a variety of data-driven capabilities.

Key Result Areas and Activities:

  • Share and Build Expertise- Develop and share expertise in AWS and Python and actively mine the experience and expertise in the organization for sharing across teams and clients in the firm. Support the Cloud and Data Engineering COE initiatives
  • Data Pipeline Development and Optimization: Design, develop, and optimize scalable ETL/ELT pipelines using AWS services such as Glue, Lambda, and Step Functions to manage large-scale data processing.
  • Data Storage and Management: Implement and manage data storage solutions like S3, Redshift, and RDS, ensuring optimal performance, cost efficiency, and compliance with data governance standards.
  • Cloud Infrastructure and Security Management: Architect and manage cloud infrastructure using AWS services such as CloudFormation, EC2, and IAM, ensuring security, reliability, and scalability of data systems.
  • Monitoring, Maintenance, and Troubleshooting: Set up monitoring and alerting systems using CloudWatch, AWS Config, and other tools to ensure system health, troubleshoot issues, and maintain high availability.
  • Collaboration and Stakeholder Communication: Collaborate with cross-functional teams, including data analysts and business stakeholders, to understand requirements, provide technical solutions, and ensure data architecture aligns with business goals.


Must have:

  • Expertise in AWS services like S3, EC2, EMR, Lambda, Glue, and Redshift.
  • Strong knowledge of cloud databases such as Aurora, Snowflake, and Singlestore.
  • Proficient in big data tools like Hadoop, Hive, Spark, and programming languages such as Scala, Python, and PySpark.
  • Advanced SQL skills with experience in developing complex ETL workflows, including SCD, deduplication, and aggregation.
  • Hands-on experience with orchestration tools like Apache Airflow.
  • Thorough understanding of AWS VPC, subnets, security groups, and route tables.


Qualifications:

  • Minimum 7+ years of IT experience with 3+ years of AWS related projects.
  • Bachelor’s degree in computer science, engineering, or related field (master’s degree is a plus)
  • Demonstrated continued learning through one or more technical certifications or related methods


Qualities:

  • Should have the capability to deep dive and research in various technical related fields
  • Self-motivated and focused on delivering outcomes for a fast-growing team and firm
  • Able to communicate persuasively through speaking, writing, and client presentations
  • Able to work in a self-organized and cross-functional team

  • Big Data Specialist

    3 weeks ago

    nagpur, India Taggd Full time

    Position: Senior Cloud Data Engineer – AWS & Big Data Location: Nagpur/PuneExperience: 7 to 9 yearsNotice Period: 30 DaysTravel: Not required however the candidate is supposed to work with global teams in a remote environmentCompensation : 26 Lacs Annually ((This is the fixed compensation for this role. Candidates with salary expectations exceeding this...

  • Big data specialist

    3 weeks ago

    Nagpur, India Taggd Full time

    Position: Senior Cloud Data Engineer – AWS & Big Data Location: Nagpur/Pune Experience : 7 to 9 years Notice Period : 30 Days Travel: Not required however the candidate is supposed to work with global teams in a remote environment Compensation : 26 Lacs Annually ((This is the fixed compensation for this role. Candidates with salary...

  • Big Data Specialist

    3 weeks ago

    Nagpur, India Taggd Full time

    Position: Senior Cloud Data Engineer – AWS & Big Data Location: Nagpur/Pune Experience : 7 to 9 years Notice Period : 30 Days Travel: Not required however the candidate is supposed to work with global teams in a remote environment Compensation : 26 Lacs Annually ((This is the fixed compensation for this role. Candidates with salary expectations...

  • Big Data Specialist

    6 days ago

    Nagpur, India Taggd Full time

    Position: Senior Cloud Data Engineer – AWS & Big DataLocation: Nagpur/PuneExperience: 7 to 9 yearsNotice Period: 30 DaysTravel: Not required however the candidate is supposed to work with global teams in a remote environmentCompensation : 26 Lacs Annually ((This is the fixed compensation for this role. Candidates with salary expectations exceeding this...

  • Big Data Specialist

    6 days ago

    nagpur, India Taggd Full time

    Position: Senior Cloud Data Engineer – AWS & Big DataLocation: Nagpur/PuneExperience : 7 to 9 yearsNotice Period : 30 DaysTravel: Not required however the candidate is supposed to work with global teams in a remote environmentCompensation : 26 Lacs Annually ((This is the fixed compensation for this role. Candidates with salary expectations...

  • Big Data Specialist

    1 week ago

    Nagpur, India Taggd Full time

    Position:Senior Cloud Data Engineer – AWS & Big DataLocation:Nagpur/PuneExperience: 7 to 9 yearsNotice Period :30 DaysTravel:Not required however the candidate is supposed to work with global teams in a remote environmentCompensation : 26 Lacs Annually ((This is the fixed compensation for this role. Candidates with salary expectations exceeding this amount...

  • Big Data Specialist

    4 weeks ago

    nagpur, India Taggd Full time

    Position: Senior Cloud Data Engineer – AWS & Big Data Location: Nagpur/PuneExperience: 7 to 9 yearsNotice Period: 30 DaysTravel: Not required however the candidate is supposed to work with global teams in a remote environmentCompensation : 26 Lacs Annually [(This is the fixed compensation for this role. Candidates with salary expectations exceeding this...

  • Big Data Specialist

    4 weeks ago

    Nagpur, India Taggd Full time

    Position: Senior Cloud Data Engineer – AWS & Big Data Location: Nagpur/Pune Experience : 7 to 9 years Notice Period : 30 Days Travel: Not required however the candidate is supposed to work with global teams in a remote environment Compensation : 26 Lacs Annually ((This is the fixed compensation for this role. Candidates with salary expectations...

  • Big Data Specialist

    4 weeks ago

    Nagpur, India Taggd Full time

    Position: Senior Cloud Data Engineer – AWS & Big Data Location: Nagpur/PuneExperience: 7 to 9 yearsNotice Period: 30 DaysTravel: Not required however the candidate is supposed to work with global teams in a remote environmentCompensation : 26 Lacs Annually [(This is the fixed compensation for this role. Candidates with salary expectations exceeding this...

  • Big Data Specialist

    3 days ago

    nagpur, India Taggd Full time

    Position: Senior Cloud Data Engineer – AWS & Big Data Location: Nagpur/Pune Experience : 7 to 9 years Notice Period : 30 Days Travel: Not required however the candidate is supposed to work with global teams in a remote environment Compensation : 26 Lacs Annually ((This is the fixed compensation for this role. Candidates with salary expectations...

  • Big Data Infrastructure Specialist

    3 weeks ago

    Bangalore/Gurgaon/Gurugram/Nagpur, India Intuitive Apps Full time

    Job Title: Big Data AdministratorAs a key member of our team at Intuitive Apps, you will play a vital role in ensuring the seamless operation and optimization of our Hadoop and Spark infrastructure.Key Responsibilities:Hadoop Installation and Deployment: Install Hadoop in Linux environments, deploy and maintain Hadoop clusters, and monitor cluster health to...

  • Senior Cloud Data Engineer

    4 weeks ago

    Nagpur, Maharashtra, India Taggd Full time

    Job Title: Senior Cloud Data Engineer - AWS & Big DataAt Taggd, we are seeking a highly skilled Senior Cloud Data Engineer to join our team. As a Senior Cloud Data Engineer, you will be responsible for designing, developing, and optimizing scalable data processing pipelines using AWS services such as Glue, Lambda, and Step Functions.Key...

  • Senior Cloud Data Engineer

    3 weeks ago

    Nagpur, Maharashtra, India Taggd Full time

    Job Title: Senior Cloud Data Engineer - AWS & Big DataJob Summary:We are seeking a highly skilled Senior Cloud Data Engineer to join our team at Taggd. As a Senior Cloud Data Engineer, you will be responsible for designing, developing, and optimizing scalable ETL/ELT pipelines using AWS services such as Glue, Lambda, and Step Functions to manage large-scale...

  • Senior Data Engineer

    1 week ago

    Nagpur, Maharashtra, India HCLTech Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a Senior Data Engineer to lead our data engineering efforts at HCLTech. The ideal candidate will have experience in designing and implementing data pipelines, data warehousing, and big data processing.Key Responsibilities:Design and implement data pipelines using Google Cloud Platform and Python...

  • Senior Big Data Engineer

    2 weeks ago

    Mumbai/Pune/Kolkata/Delhi/Nagpur/Ahmedabad, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Job Title: Senior Big Data EngineerAbout the Role:We are seeking a highly skilled Senior Big Data Engineer to join our team at AEXONIC TECHNOLOGIES PRIVATE LIMITED. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining robust data pipelines that support large-scale data processing and analytics using...

  • Big Data Administrator

    2 weeks ago

    Bangalore/Gurgaon/Gurugram/Nagpur, India Intuitive Apps Full time

    We are seeking a highly skilled Big Data Administrator to play a crucial role in ensuring the smooth operation and optimization of our Hadoop and Spark infrastructure. To be successful in this role, you will need:• Hadoop Installation and Deployment: Install Hadoop in Linux environments and deploy and maintain Hadoop clusters.• Hadoop Administration:...

  • Data Security Specialist

    3 days ago

    Nagpur, Maharashtra, India Paramount Computer Systems Full time

    Data Security SpecialistWe are seeking a highly skilled Data Security Specialist to join our team at Paramount Computer Systems. The ideal candidate will have expertise in Data Loss Prevention (DLP) as the primary focus, as well as experience with technologies like Hardware Security Modules (HSM), Information Rights Management (IRM), Data Classification, and...

  • Big Data Administrator

    4 weeks ago

    Bangalore/Gurgaon/Gurugram/Nagpur, IN Intuitive Apps Full time

    As a Big Data Admin, you will play a crucial role in ensuring the smooth operation and optimization of our Hadoop and Spark infrastructure. Your responsibilities will include :Hadoop Installation and Deployment :- Install Hadoop in Linux environments.- Deploy and maintain Hadoop clusters.- Monitor cluster health to ensure continuous uptime.- Analyze storage...

  • Data Entry Specialist

    6 days ago

    Nagpur, Maharashtra, India Shri Shiv Shakti Education Society (SSSES) Full time

    Data Entry Responsibilities:The ideal candidate will gather, collate, and prepare documents, materials, and information for data entry in a timely and accurate manner.They will conduct research to obtain information for incomplete documents and materials, ensuring all necessary details are captured.The selected individual will create digital documents from...

  • Senior Big Data Engineer

    2 weeks ago

    Mumbai/Pune/Kolkata/Delhi/Nagpur/Ahmedabad, IN AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Position - Senior Big Data Engineer (GCP)Experience - 5 to 8 YrsLocation - RemoteShift - EST Shift 5:30 PM to 2:30 AMWe are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The successful candidate will be...