Data Engineer

3 days ago

sany, India Randstad India Full time
This role will design develop and maintainthe data processing platform on Azure. The purpose of thedata
platform is to integrate data across theorganization to empower and provide business partners vendorsand
customers with actionable insights. The rightcandidate will implement best practices using expertise inAzure
Data Services to build a scalable secure andgoverned platform. Their expertise will providecontinued Responsibilities /Accountabilities:
Develop pipelines in Synapse thatingest data from a growing number of data sources.
Implement data quality checks and validation processes to ensureaccuracy consistency and integrity.
Identify design andintegrate process improvements: automate manual processes timelydata delivery
and redesigning for future usecases.
Engage business partners to deeply understand thebusiness requirements for all data transformations.
Monitor pipeline operations tasks resource utilization andfailures.
Support HA DR Backup and retention policies onall data platforms Ensure compliance with IT General
Controls provide needed information in support of audits and tosubstantiate process and controls
compliance.
Produce documentation for data models transformations businessrules and lessons learned that allows
other staffmembers to understand the ingestion process and maintain andtroubleshoot it
Understand technical requirement ofproject and convert requirement to junior team membersfor
execution
Mentoring and leading juniordata engineers in best practices and techniques for on timedelivery of data
products.
Technical lead indata engineering space
Drive continued development ofdata engineering skills for junior data engineers
Requirements (education experience competencies and specific jobrequirements):
10 years of IT experience in Data andAnalytics data integration or data ingestion.
3 years ofexperience in Azure Cloud Services (PaaS & IaaS) Azure DataFactory Azure Synapse
Analytics Azure Analysis ServiceApplication Insights Azure Monitoring Azure Data Lake.2 Education /Certification:
Bachelor's degree in computerscience.
Certifications considered a plus especiallythose focused on data and analytics
Experience andSkills:
Collaborations across Data intelligence crossfunctional team
Good experience in tracking and loggingend to end software application build using Azure DevOps.
Having Data warehousing experience in BusinessIntelligence Technologies and Database with Extensive
Knowledge in Data analysis TSQL queries ETL and ELT processReporting services using (Power BI).
Design Enterpriselevel data warehouse solutions and lead multipleimplementations.
Have good experience designingcloudbased solutions in Azure by creating Azure SQL databasesetting
up Elastic pool jobs and designing tabularmodels in Azure analysis services.
Have extensiveexperience in creating pipeline jobs schedule triggers using Azuredata factory.
Experienced ability in performance TuningQuery Optimization
Involved in full life cycle ofsoftware design process of projects including prototyping proof ofconcepts
design interface implementation testing andmaintenance.
Good experience in maintaining versioncontrol using Azure Dev Ops.
Knowledge of SAP sourcesystem and BW is a plus.
Emotional intelligence flexiblework style and excellent diplomatic skills across all levels ofan
organization
Strong oral and writtencommunication skills with a high degree of comfort with varyingtypes of
audiences.
Experience designing anddelivering complex solutions on time and with expectedquality.

  • Data Engineer

    2 months ago

    Sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...

  • Data Engineer

    2 weeks ago

    sany, India Informica Full time

    Job Description Experience Required: 48 yrs. Knowledge on Data Modelling Data warehouse andData Analysis is also required. Immediate requirement: 1520 days joineronly. Data Engineer Key Skills: Azure Data Factory Pyspark T/SQLPL/SQL Exposure on other ETL Tools like SSIS DatabricksLooker Data Engineering Create and maintain optimal datapipeline...

  • Data Engineer

    2 weeks ago

    Sany, India Kenan Management Consultants Pvt Ltd Full time

    Job Title: Data EngineerExperience: Minimum 4-5 years of experience in Development in Informatica Big Data Management/ DEI & Informatica Power CenterSkills Required: ETL, SQL, Scoop, Spark, Hive, Hadoop, KAFKAPreferred: Knowledge of PySparkEducation: Bachelors degree in Computer Science or equivalent; Masters preferredMain Duties & Responsibilities:Building...

  • Data Engineer

    2 weeks ago

    Sany, India Bitcoin Devs Company Full time

    Overview:TheData Engineer Lead plays a crucial role in our organization workingremotely to design develop and maintain scalable data pipelines andinfrastructures for our data platforms. This position is vital inensuring the efficiency reliability and quality of our datasolutions enabling our teams to make informed decisions and drivebusinessgrowth.TheData...

  • Data engineer

    2 weeks ago

    Sany, India HR Aspiration Full time

    Senior Data EngineerExpreine : 3 10Years WorkLocation :BangaloreMandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServerMust HaveExperience:6 yearsof handson data engineeringexperienceExpertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDBBuildingbatch and realtime data pipelinesPython SQLcoding for data processing...

  • Data Engineer

    3 months ago

    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    2 weeks ago

    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    2 weeks ago

    Sany, India NewPage Solution Inc Full time

    Who Are We NewPage is a digital health solutions company. Wedevote ourselves to advancing the quality of life by enhancing thehealth and optimizing the longevity of people. We do this bypassionately building futuristic technologies for globalorganizations across the healthcare ecosystem. We partake at everystage from problem definition strategy & service...

  • Data Engineer

    2 weeks ago

    Sany, India NewPage Solution Inc Full time

    Who Are We NewPage is a digital health solutions company. Wedevote ourselves to advancing the quality of life by enhancing thehealth and optimizing the longevity of people. We do this bypassionately building futuristic technologies for globalorganizations across the healthcare ecosystem. We partake at everystage from problem definition strategy & service...

  • Data Engineer

    2 weeks ago

    sany, India Informica Full time

    Data EngineerTide Experience5 to 8 Years Number of Position(s) 5 MandatorySkills SQL Distributed ETLData Pipeline Building Data modeling Snowflake JobDescription LocationGurgram/Bangalore MANDATORY SKILLSET Team Management SQL ExpertDistributed ETL Data Pipeline Building Data Modeling KPIs Knowledgeof Snowflake As part of theteam you will be...

  • Data Engineer Azure

    5 days ago

    Sany, India TCP Corps Full time

    Required Skills Python Pyspark Azure DataFactory SQL DataModellingOverview:TheData Engineer (Azure) plays a crucial role in our organizationresponsible for designing developing and maintaining scalable datapipelines for data ingestion transformation and storage on Azurecloud platform. This position is pivotal in ensuring the efficiencyand reliability of data...

  • Snowflake Data Engineer

    2 weeks ago

    sany, India Agilite Global Solutions Company Full time

    Role: Snowflakes Data Engineer Location: India (Remote Work) Minimum Qualification: Bachelor's degree or higher in the technology field Experience: 3+ years Domain: US Healthcare Customer Profile: Captive research and development pods for a 500-million-member group of pharma data research companies that assist patients in accessing life-saving...

  • Data Engineer AWS2

    6 days ago

    Sany, India TCP Corps Full time

    Required Experience AWS ETL Data ModellingData Integration Data Manipulation GITHUB Azure Devops DatabrickGood to havepytestWeare seeking a highly skilled AWS Data Engineer to join our dynamicteam. As an AWS Data Engineer you will be responsible for designingbuilding and maintaining data pipelines and ETL processes on theAWS platform. In addition to your...

  • Data Engineer

    4 weeks ago

    Sany, India Kenan Management Consultants Pvt Ltd Full time

    Job Description Therole requires data ingestion processing and extraction of data to& from Hadoop Cluster only using Informatica BDM. Itrequires extensive experience in ETL SQL Scoop Spark Hive Hadoop& KAFKA. Knowledge of PySpark will bepreferable Job Title DataEngineer Experience Minimum 45 years ofExperience in Development in Informatica Big...

  • Data Engineer with Datastage

    2 weeks ago

    sany, India eTek IT Services, Inc. Full time

    Role : DataEngineer Location: CincinnatiOhio Experience:5years W2Contract JobDescriptionJobOverview: Weare seeking a skilled Data Engineer with a strong background inmortgage banking to join our IT team. The candidate will beinstrumental in constructing testing and maintaining our mortgagebanking data architecture. This includes optimizing data flow...

  • Python Data Engineer

    4 weeks ago

    sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/Developer Exp: 3 YearsRelevant Location: PANIndia Positions: 1 Budget: 15LPA Notice: Immediate joinersonly JD: KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources. Develop manage and...

  • Python Data Engineer

    6 days ago

    Sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/DeveloperExp: 3 YearsRelevantLocation: PANIndiaPositions: 1Budget: 15LPANotice: Immediate joinersonlyJD:KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources.Develop manage and optimize...

  • Data Engineer

    7 days ago

    Sany, India Overture Rede Private Limited Full time

    DataEngineer. KeySkills: Azure Data Factory Pyspark T/SQLPL/SQL Exposure on other ETL Tools like SSIS Databricks DataEngineering Create and maintain optimal data pipelinearchitecture Design and develop Data Warehouse solutions Assemble large complex data sets that meet functional /nonfunctional business requirements. Identify designand implement internal...

  • Data Engineer

    2 days ago

    sany, India Overture Rede Private Limited Full time

    DataEngineer .KeySkills :Azure Data Factory Pyspark T/SQLPL/SQL Exposure on other ETL Tools like SSIS Databricks DataEngineeringCreate and maintain optimal data pipelinearchitectureDesign and develop Data Warehouse solutionsAssemble large complex data sets that meet functional /nonfunctional business requirements.Identify designand implement internal process...

  • Data Engineer AWS1

    5 days ago

    Sany, India TCP Corps Full time

    Contributes to community buildinginitiatives like CoECoPResponsibilities:Designand Develop Data Solutions: Architect build andoptimize data pipelines and ETL processes on AWS using serviceslike Amazon Redshift Amazon RDS AWS Glue and AWS Lambda.Collaborate with crossfunctional teams to understand datarequirements and translate them into...