Data Engineer

4 weeks ago


Sany, India Revolve Solutions Full time
Data EngineerJobSummaryWe are looking for an experiencedData Engineer to assist in developing a comprehensive data pipelinearchitecture to support the management in making decisions based ondata.
MandatorySkillset
  • Background in ComputerScience Computer Engineer or Data Science;
  • Atleast 35 years of total IT experience and 2 years of experience indata engineering;
  • Working knowledge ofprogramming languages such as SQL andPython;
  • Experience in building data pipelineswith Python and or Apache Spark
  • Experience inworking with Infrastructure as Code like Cloudformation orTerraform
  • Experience in cloud data warehousesuch as AWS Redshift Teradata Oracle Exacdata Machine or ClouderaEnterprise Data Hub;
  • Experience in data modeldesigning such as Star Schema orSnowflake;
  • Familiar with big data streamingtools and database frameworks such as Apache NiFi Storm SparkHadoop Tableau;
  • Good writing communication andpresentation skills;
  • Fast learner and abilityto workindependently.

DesiredSkillset / Good to have
  • Exposure inHadoop or big data.
  • Agile Scrum / Devopsknowledge
Responsibilities
  • Designdevelop document and implement endtoend data pipelines and dataintegration processes both batch andrealtime;
  • Perform data analysis data profilingdata cleansing data lineage data mapping and datatransformation;
  • Develop ETL / ELT jobs andworkflows and deployment of datasolutions;
  • Monitor recommend develop andimplement ways to improve data quality including reliabilityefficiency and cleanliness to optimize and finetuneprocesses;
  • Recommend execute and deliver bestpractices in data management and data lifecycle processes includingmodular development of data processes coding and configurationstandards error handling and notification standards auditingstandards and data archivalstandards;
  • Collaborate with differentstakeholders to understand data needs gather requirements andimplement data solutions to deliver businessgoals;
  • Provide technical support for any dataissues and change requests document all investigations findingsrecommendations andresolutions.
Industry
  • InformationTechnology &Services
EmploymentTypeFulltime

clouderaenterprise data hub,spark,apache nifi,aws redshift,bigdata,hadoop,tableau,teradata,snowflake,storm,cloudformation,aws,sql,oracleexacdata machine,python,devops,agile scrum,terraform,starschema


  • Data Engineer

    4 weeks ago


    Sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...

  • Data Engineer

    1 week ago


    sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...

  • Data engineer

    2 weeks ago


    Sany, India HR Aspiration Full time

    Senior Data EngineerExpreine : 3 10Years WorkLocation :BangaloreMandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServerMust HaveExperience:6 yearsof handson data engineeringexperienceExpertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDBBuildingbatch and realtime data pipelinesPython SQLcoding for data processing...

  • Data engineer

    5 days ago


    sany, India HR Aspiration Full time

    Senior Data Engineer Expreine : 3 10Years WorkLocation :Bangalore MandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServer Must HaveExperience: 6 yearsof handson data engineeringexperience Expertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDB Buildingbatch and realtime data pipelines Python SQLcoding for data...

  • Data Engineer

    4 weeks ago


    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    4 weeks ago


    sany, India TalentPulse Consultant Full time

    Overview: The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Azure Data Engineer

    7 days ago


    sany, India SAM Manpower and Career Services LLP Full time

    Azure Data Engineer with DataVisualization Expert JobDescription JobSummary: We are seeking a skilledSenior Data Engineer with expertise in data visualizationparticularly in Azure Databricks Synapse Power BI and Tableau. Theideal candidate will play a crucial role in designing andoptimizing data architecture implementing ETL processes andcreating...

  • Data Engineer

    4 weeks ago


    Sany, India Bista Univarsal Limited Full time

    Overview:The DataEngineer plays a crucial role in our organization by designingdeveloping and maintaining scalable data architecture for ourdataintensive applications. They work closely with data scientistsanalysts and other stakeholders to ensure efficient data flow andutilization across the organization.KeyResponsibilities:Design andimplement scalable data...

  • Data Engineer

    3 weeks ago


    sany, India Bista Univarsal Limited Full time

    Overview: The DataEngineer plays a crucial role in our organization by designingdeveloping and maintaining scalable data architecture for ourdataintensive applications. They work closely with data scientistsanalysts and other stakeholders to ensure efficient data flow andutilization across the organization.KeyResponsibilities: Design andimplement scalable...


  • sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/Developer Exp: 3 YearsRelevant Location: PANIndia Positions: 1 Budget: 15LPA Notice: Immediate joinersonly JD: KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources. Develop manage and...


  • Sany, India BigShyft Full time

    AboutCompany:Our client is aninnovative startup that specializes in data infrastructuresolutions. With a focus on automation and reliability they empowerorganizations to harness the power of their data effectively.Recently acquired their team is expanding and they are seekingtalented individuals to join us in ourmission.JobDescription:As a DatabricksData...

  • Azure Data Engineer

    3 weeks ago


    sany, India Zerozilla Full time

    No. of Position: 2 Position: Azure Data Engineer Exp: 58Years Location: Bangalore Hybrid NP: Only Immediate/15 Days Mandatoryskills: ADF ADB Azure Synapse analytics. JD: There is a client round for this position. Hence look fortechnically hands on candidates for this role. Job Description:Essential Skills Synapse/ Azure SQL DWH Data Modelling &...

  • Azure Data Engineer

    4 weeks ago


    Sany, India Zerozilla Full time

    No. of Position: 2Position: Azure Data Engineer Exp: 58Years Location: Bangalore HybridNP: Only Immediate/15 Days Mandatoryskills: ADF ADB Azure Synapse analytics. JD: There is a client round for this position. Hence look fortechnically hands on candidates for this role. Job Description:Essential Skills Synapse/ Azure SQL DWH Data Modelling & Thereis an...

  • AWS Data Engineer

    1 week ago


    sany, India TalentPulse Consultant Full time

    Overview: The AWS DataEngineer plays a crucial role in our organization by designing andimplementing scalable reliable and secure data solutions in the AWScloud environment. They are responsible for developing andmaintaining data pipelines optimizing data workflows and ensuringthe quality and integrity of our data. This position is essentialfor leveraging...


  • Sany, India eTek IT Services, Inc. Full time

    Role :DataEngineerLocation: CincinnatiOhioExperience:5yearsW2ContractJobDescriptionJobOverview:Weare seeking a skilled Data Engineer with a strong background inmortgage banking to join our IT team. The candidate will beinstrumental in constructing testing and maintaining our mortgagebanking data architecture. This includes optimizing data flow andcollection...


  • sany, India eTek IT Services, Inc. Full time

    Role : DataEngineer Location: CincinnatiOhio Experience:5years W2Contract JobDescriptionJobOverview: Weare seeking a skilled Data Engineer with a strong background inmortgage banking to join our IT team. The candidate will beinstrumental in constructing testing and maintaining our mortgagebanking data architecture. This includes optimizing data flow...


  • Sany, India Tekwissen India Full time

    Overview TekWissen Group isa workforce management provider operating throughout India andseveral other countries worldwide. The client below is a leadingtechnology company offering a range of IT solutions to businessesand organizations enabling them to transform their digital futures Position: ConsultantData Engineering Location: Bangalore ...


  • Sany, India CGVAK Software AND Exports Limited Full time

    Overview:TheDatabricks Spark Developer plays a crucial role in harnessing thepower of data using Databricks and Spark to develop and maintainefficient data pipelines. They are responsible for implementingscalable and reliable solutions that enable datadrivendecisionmaking within the organization.KeyResponsibilities:Designing andimplementing robust ETL...

  • Data Engineer

    4 hours ago


    sany, India Agilite Global Solutions Company Full time

    Role: DataEngineer Location: India Remote Work from Anywhere inIndiaMinimum Qualification: B. Tech. or equivalent from an accreditedinstitutionIndicativeExperience: 6YearsDomain: USHealthCare.Customer Profile: Captive research and development pods for a 500millionmember group of pharma data research companies that helppatients gain access to lifesaving...

  • GCP Data Engineer

    3 weeks ago


    Sany, India AugmntX Full time

    Shift Time: 129 pm / 110 pmISTJobDescription:Please find below the highlevelresponsibilities (not just limited to below). This is a migrationproject from Snowflake to GCP Big Query however the components inAzure need to be migrated to equivalent GCP components aswell.Experience: 6yearsKeyResponsibilities: Work closely with the dataengineering and analytics...