Big Data Engineer

2 weeks ago


Sany, India TalentPulse Consultant Full time
JobDescription:We are currentlyseeking a highly skilled Big Data Engineer to join our team on aremote basis. The ideal candidate will have at least 5 years ofexperience in Big Data technologies and a strong proficiency inPython Spark and Scala. This is an active position with a highpriority offering a competitive rate and the opportunity for alongterm engagement.KeyResponsibilities:
  • Designdevelop and maintain Big Data solutions andapplications.
  • Implement data pipelines and ETLprocesses using Python Spark andScala.
  • Optimize and troubleshoot Big Datasolutions for performance andscalability.
  • Collaborate with crossfunctionalteams to gather requirements and deliver solutions that meetbusiness needs.
  • Perform data analysis andprovide insights to support decisionmakingprocesses.
  • Stay updated with emergingtechnologies and best practices in Big Dataengineering.
Requirements:
  • Bachelorsdegree in Computer Science Engineering or a relatedfield.
  • Proven experience as a Big Data Engineeror similar role with at least 5 years of relevant workexperience.
  • Proficiency in Python Spark andScala is a must.
  • Strong understanding of BigData technologies and architectures.
  • Experiencewith distributed computing frameworks such as Hadoop or ApacheFlink.
  • Familiarity with cloud platforms likeAWS Azure or Google Cloud Platform.
  • Excellentproblemsolving and analytical skills.
  • Strongcommunication and collaboration skills.
  • Abilityto work independently and manage priorities in a remoteenvironment.
  • Prior experience working inAgile/Scrum methodologies ispreferred.
Duration:
  • Thisis a fulltime position with a duration of 3 months with thepossibility of extension based on performance and projectneeds.

data,bigdata,python,scala,spark,cloud,data solutions,skills,big datatechnologies,aws


  • Big Data Engineer

    2 months ago


    sany, India TalentPulse Consultant Full time

    JobDescription: We are currentlyseeking a highly skilled Big Data Engineer to join our team on aremote basis. The ideal candidate will have at least 5 years ofexperience in Big Data technologies and a strong proficiency inPython Spark and Scala. This is an active position with a highpriority offering a competitive rate and the opportunity for alongterm...

  • Big Data Architect

    2 months ago


    sany, India Valiance Analytics Full time

    We are looking for a Senior Architect with12+ years of experience to join our team. The ideal candidate willhave astrong background in Python, SQL, pyspark, Hadoop,Hive, Delta Lake, and must have experience with Airflow.The Senior Architect will be responsible for designing,developing, and implementing complex data solutions for ourclients.The candidate must...

  • GCP Data Engineer

    2 months ago


    Sany, India AugmntX Full time

    Shift Time: 129 pm / 110 pmISTJobDescription:Please find below the highlevelresponsibilities (not just limited to below). This is a migrationproject from Snowflake to GCP Big Query however the components inAzure need to be migrated to equivalent GCP components aswell.Experience: 6yearsKeyResponsibilities: Work closely with the dataengineering and analytics...

  • GCP Data Engineer

    1 month ago


    sany, India AugmntX Full time

    Shift Time: 129 pm / 110 pmISTJobDescription:Please find below the highlevelresponsibilities (not just limited to below). This is a migrationproject from Snowflake to GCP Big Query however the components inAzure need to be migrated to equivalent GCP components aswell.Experience: 6yearsKeyResponsibilities: Work closely with the dataengineering and analytics...

  • Data Engineer

    2 weeks ago


    Sany, India Kenan Management Consultants Pvt Ltd Full time

    Job Description Therole requires data ingestion processing and extraction of data to& from Hadoop Cluster only using Informatica BDM. Itrequires extensive experience in ETL SQL Scoop Spark Hive Hadoop& KAFKA. Knowledge of PySpark will bepreferable Job Title DataEngineer Experience Minimum 45 years ofExperience in Development in Informatica Big...

  • GCP Data Engineer

    24 hours ago


    sany, India AugmntX Full time

    Shift Time: 129 pm / 110 pmISTJobDescription:Please find below the highlevelresponsibilities (not just limited to below). This is a migrationproject from Snowflake to GCP Big Query however the components inAzure need to be migrated to equivalent GCP components aswell.Experience:6yearsKeyResponsibilities: Work closely with the dataengineering and analytics...

  • Data Engineer

    2 months ago


    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    1 day ago


    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    2 months ago


    sany, India TalentPulse Consultant Full time

    Overview: The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data engineer

    1 month ago


    sany, India HR Aspiration Full time

    Senior Data Engineer Expreine : 3 10Years WorkLocation :Bangalore MandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServer Must HaveExperience: 6 yearsof handson data engineeringexperience Expertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDB Buildingbatch and realtime data pipelines Python SQLcoding for data...

  • Data engineer

    16 hours ago


    Sany, India HR Aspiration Full time

    Senior Data EngineerExpreine : 3 10Years WorkLocation :BangaloreMandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServerMust HaveExperience:6 yearsof handson data engineeringexperienceExpertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDBBuildingbatch and realtime data pipelinesPython SQLcoding for data processing...

  • Data Engineer

    18 hours ago


    Sany, India Kenan Management Consultants Pvt Ltd Full time

    Job Title: Data EngineerExperience: Minimum 4-5 years of experience in Development in Informatica Big Data Management/ DEI & Informatica Power CenterSkills Required: ETL, SQL, Scoop, Spark, Hive, Hadoop, KAFKAPreferred: Knowledge of PySparkEducation: Bachelors degree in Computer Science or equivalent; Masters preferredMain Duties & Responsibilities:Building...

  • AWS Data Engineer

    2 months ago


    Sany, India TalentPulse Consultant Full time

    Overview:The AWS DataEngineer plays a crucial role in our organization by designing andimplementing scalable reliable and secure data solutions in the AWScloud environment. They are responsible for developing andmaintaining data pipelines optimizing data workflows and ensuringthe quality and integrity of our data. This position is essentialfor leveraging...

  • AWS Data Engineer

    2 weeks ago


    Sany, India TalentPulse Consultant Full time

    Overview:The AWS DataEngineer plays a crucial role in our organization by designing andimplementing scalable reliable and secure data solutions in the AWScloud environment. They are responsible for developing andmaintaining data pipelines optimizing data workflows and ensuringthe quality and integrity of our data. This position is essentialfor leveraging...

  • AWS Data Engineer

    1 month ago


    sany, India TalentPulse Consultant Full time

    Overview: The AWS DataEngineer plays a crucial role in our organization by designing andimplementing scalable reliable and secure data solutions in the AWScloud environment. They are responsible for developing andmaintaining data pipelines optimizing data workflows and ensuringthe quality and integrity of our data. This position is essentialfor leveraging...


  • Sany, India Relic Consultancy Services Full time

    Responsibilities:Experience: 36 yrsGood developmentpracticesHands on coder with good experiencein programming languages like Java Python orScala.Handson experience on the Big Data stacklike Hadoop Mapreduce Spark Hbase andElasticSearch.Good understanding ofprogramming principles and development practices like checkinpolicy unit testing code...


  • Sany, India Relic Consultancy Services Full time

    Responsibilities:Experience: 36 yrsGood developmentpracticesHands on coder with good experiencein programming languages like Java Python orScala.Handson experience on the Big Data stacklike Hadoop Mapreduce Spark Hbase andElasticSearch.Good understanding ofprogramming principles and development practices like checkinpolicy unit testing code...


  • Sany, India Relic Consultancy Services Full time

    Responsibilities:Experience: 36 yrsGood developmentpracticesHands on coder with good experiencein programming languages like Java Python orScala.Handson experience on the Big Data stacklike Hadoop Mapreduce Spark Hbase andElasticSearch.Good understanding ofprogramming principles and development practices like checkinpolicy unit testing code...


  • sany, India Relic Consultancy Services Full time

    Responsibilities: Experience: 36 yrs Good developmentpractices Hands on coder with good experiencein programming languages like Java Python orScala. Handson experience on the Big Data stacklike Hadoop Mapreduce Spark Hbase andElasticSearch. Good understanding ofprogramming principles and development practices like checkinpolicy unit testing code deployment...


  • sany, India Agilite Global Solutions Company Full time

    Role: Snowflakes Data Engineer Location: India (Remote Work) Minimum Qualification: Bachelor's degree or higher in the technology field Experience: 3+ years Domain: US Healthcare Customer Profile: Captive research and development pods for a 500-million-member group of pharma data research companies that assist patients in accessing life-saving...