Big Data Engineer

4 weeks ago


sany, India TalentPulse Consultant Full time
JobDescription: We are currentlyseeking a highly skilled Big Data Engineer to join our team on aremote basis. The ideal candidate will have at least 5 years ofexperience in Big Data technologies and a strong proficiency inPython Spark and Scala. This is an active position with a highpriority offering a competitive rate and the opportunity for alongterm engagement.KeyResponsibilities:
  • Designdevelop and maintain Big Data solutions andapplications.
  • Implement data pipelines and ETLprocesses using Python Spark andScala.
  • Optimize and troubleshoot Big Datasolutions for performance andscalability.
  • Collaborate with crossfunctionalteams to gather requirements and deliver solutions that meetbusiness needs.
  • Perform data analysis andprovide insights to support decisionmakingprocesses.
  • Stay updated with emergingtechnologies and best practices in Big Dataengineering.
Requirements:
  • Bachelorsdegree in Computer Science Engineering or a relatedfield.
  • Proven experience as a Big Data Engineeror similar role with at least 5 years of relevant workexperience.
  • Proficiency in Python Spark andScala is a must.
  • Strong understanding of BigData technologies and architectures.
  • Experiencewith distributed computing frameworks such as Hadoop or ApacheFlink.
  • Familiarity with cloud platforms likeAWS Azure or Google Cloud Platform.
  • Excellentproblemsolving and analytical skills.
  • Strongcommunication and collaboration skills.
  • Abilityto work independently and manage priorities in a remoteenvironment.
  • Prior experience working inAgile/Scrum methodologies ispreferred.
Duration:
  • Thisis a fulltime position with a duration of 3 months with thepossibility of extension based on performance and projectneeds.

data,bigdata,python,scala,spark,cloud,data solutions,skills,big datatechnologies,aws


  • Big Data QA Engineer

    4 weeks ago


    Sany, India True Tech Professionals Full time

    Job Description: We are seeking a skilled andexperienced Big Data Quality Assurance (QA) Engineer to join ourteam. As a Big Data QA Engineer you will play a critical role inensuring the accuracy reliability and performance of our big datasolutions. You will collaborate closely with our development anddata science teams to design and execute comprehensive...

  • Big Data Architect

    4 days ago


    Sany, India Valiance Analytics Full time

    We are looking for a Senior Architect with12+ years of experience to join our team. The ideal candidate willhave a strong background in Python, SQL, pyspark, Hadoop,Hive, Delta Lake, and must have experience with Airflow.The Senior Architect will be responsible for designing,developing, and implementing complex data solutions for ourclients. The candidate...

  • GCP Data Engineer

    3 weeks ago


    Sany, India AugmntX Full time

    Shift Time: 129 pm / 110 pmISTJobDescription:Please find below the highlevelresponsibilities (not just limited to below). This is a migrationproject from Snowflake to GCP Big Query however the components inAzure need to be migrated to equivalent GCP components aswell.Experience: 6yearsKeyResponsibilities: Work closely with the dataengineering and analytics...

  • GCP Data Engineer

    1 week ago


    sany, India AugmntX Full time

    Shift Time: 129 pm / 110 pmISTJobDescription:Please find below the highlevelresponsibilities (not just limited to below). This is a migrationproject from Snowflake to GCP Big Query however the components inAzure need to be migrated to equivalent GCP components aswell.Experience: 6yearsKeyResponsibilities: Work closely with the dataengineering and analytics...

  • Data Engineer

    4 weeks ago


    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    4 weeks ago


    sany, India TalentPulse Consultant Full time

    Overview: The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data engineer

    5 days ago


    sany, India HR Aspiration Full time

    Senior Data Engineer Expreine : 3 10Years WorkLocation :Bangalore MandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServer Must HaveExperience: 6 yearsof handson data engineeringexperience Expertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDB Buildingbatch and realtime data pipelines Python SQLcoding for data...

  • Data engineer

    2 weeks ago


    Sany, India HR Aspiration Full time

    Senior Data EngineerExpreine : 3 10Years WorkLocation :BangaloreMandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServerMust HaveExperience:6 yearsof handson data engineeringexperienceExpertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDBBuildingbatch and realtime data pipelinesPython SQLcoding for data processing...

  • AWS Data Engineer

    1 week ago


    sany, India TalentPulse Consultant Full time

    Overview: The AWS DataEngineer plays a crucial role in our organization by designing andimplementing scalable reliable and secure data solutions in the AWScloud environment. They are responsible for developing andmaintaining data pipelines optimizing data workflows and ensuringthe quality and integrity of our data. This position is essentialfor leveraging...


  • sany, India Relic Consultancy Services Full time

    Responsibilities: Experience: 36 yrs Good developmentpractices Hands on coder with good experiencein programming languages like Java Python orScala. Handson experience on the Big Data stacklike Hadoop Mapreduce Spark Hbase andElasticSearch. Good understanding ofprogramming principles and development practices like checkinpolicy unit testing code deployment...

  • Data Engineer

    4 weeks ago


    Sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...

  • Data Engineer

    1 week ago


    sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...

  • Data Engineer

    3 weeks ago


    Sany, India Quation Solution Private Ltd Full time

    Overview:The DataEngineer plays a crucial role in the organizations datainfrastructure responsible for developing constructing testing andmaintaining architectures such as databases and largescaleprocessing systems. They work closely with data scientists andanalysts to understand their information needs and then designbuild and manage data from raw data to...

  • Data Engineer

    2 weeks ago


    sany, India Quation Solution Private Ltd Full time

    Overview: The DataEngineer plays a crucial role in the organizations datainfrastructure responsible for developing constructing testing andmaintaining architectures such as databases and largescaleprocessing systems. They work closely with data scientists andanalysts to understand their information needs and then designbuild and manage data from raw data to...

  • Data Engineer

    4 weeks ago


    Sany, India Bista Univarsal Limited Full time

    Overview:The DataEngineer plays a crucial role in our organization by designingdeveloping and maintaining scalable data architecture for ourdataintensive applications. They work closely with data scientistsanalysts and other stakeholders to ensure efficient data flow andutilization across the organization.KeyResponsibilities:Design andimplement scalable data...

  • Data Engineer

    3 weeks ago


    sany, India Bista Univarsal Limited Full time

    Overview: The DataEngineer plays a crucial role in our organization by designingdeveloping and maintaining scalable data architecture for ourdataintensive applications. They work closely with data scientistsanalysts and other stakeholders to ensure efficient data flow andutilization across the organization.KeyResponsibilities: Design andimplement scalable...


  • Sany, India Valiance Analytics Full time

    We are looking for a skilled Project Managerwith 4-7 years of experience in Big Data Analytics and Data Lakeprojects to join our team. The ideal candidate will have a strongbackground in managing complex projects, a deep understanding ofBig Data technologies, and experience working with DataLakes. Responsibilities: Lead and manage Big Data Analytics and Data...


  • sany, India Valiance Analytics Full time

    We are looking for a skilled Project Managerwith 4-7 years of experience in Big Data Analytics and Data Lakeprojects to join our team. The ideal candidate will have a strongbackground in managing complex projects, a deep understanding ofBig Data technologies, and experience working with DataLakes. Responsibilities: Lead and manage Big Data Analytics and...


  • Sany, India CGVAK Software AND Exports Limited Full time

    Overview:TheDatabricks Spark Developer plays a crucial role in harnessing thepower of data using Databricks and Spark to develop and maintainefficient data pipelines. They are responsible for implementingscalable and reliable solutions that enable datadrivendecisionmaking within the organization.KeyResponsibilities:Designing andimplementing robust ETL...


  • Sany, India Bytemetrics Solutions Full time

    Skillsets QualificationCandidate who has attained aGraduate degree in Computer Science Statistics InformaticsInformation Systems or another quantitative field.Understanding of data mining mathematics andstatistical analysis Understanding ofpattern recognition and predictive modeling experienceHands on knowledge with Excel SQL PowerPointTableau Qlik Sense...