Sr Data Engineer

2 weeks ago

Sany, India Talent Pal Full time
Date: 19 Apr 2024

Location:
KW

Company:
AlghanimIndustries

Long Description Job Summary
Oversee and manage various aspects of data integrationand data warehouse processes. This includes implementing dataquality measures designing and deploying integration solutionscollaborating with team members troubleshooting production issuesrefining best practices educating end users participating in codereviews exploring and adopting new technologies leading prototypedevelopment and ensuring adherence to industry standards. The roleinvolves working within Agile teams reporting on project status andpartnering with IT Solution Architects to optimize data integrationdesigns. The goal is to contribute to efficient and effective dataanalytics integration solutions while staying informed abouttechnological trends and mentoring team members.
JobResponsibilities
Operational Work 75% of time

Implement Data Warehouse data qualityprocesses. Provide solutions where issues are identified

Design develop test and deploy dataintegration solutions based on business requirements

Collaborate with team members on dataintegration designs and alternatives

Troubleshoot and resolve production issues

Continually refine and document data integration best practices

Educate end users (where applicable) in theuse of metadata and understanding where data originates

Participate in code reviews

Identify evaluate and refine leadingedge dataintegration tools and methods

Build prototypesand POCs

Bring a passion to stay on top oftech trends experiment with and learn new technologies participatein internal & external technology communities and mentorother members of the engineering community

Ownthe development of crossfunctional multiplatform prototypes

Work within and across Agile teams to designdevelop test implement and support data analytics integrationsolutions

Document and support deploymentactivities

Report on status of IT DataOperations products and projects on a regular and timely basis

Ensure the timely resolution of issues

Follow standards and guidelines according toindustry best practices

Escalate anticipatedrisks to management promptly and properly

Partner with IT Solution Architects regarding data integrationdesign options

Strategic Work 25%

Educate and inform yourself and team membersabout data integration technology solutions and emerging trends

Continually participate in visioning exercisesand contribute to the data strategy

CandidateRequirements

Required years ofrelevant experience:
4 years of experiencedesigning developing and maintaining data integration solutions

DesiredQualifications:
Education B.S. in ComputerScience or related discipline.

Advanced degreea plus

SpecializedSkills:
Required:
Data integration development experience with the following skillsets:

Extract Transformation and Load (ETL) ofdisparate data sources to targets including databases files andAPIs. Talend Matillion Glue Data Studio preferred

Ability to detect identify and resolve sourceto target performance / load issues

Expertlevel proficiency in structured query language (SQL)

o Data Warehousing

  • Thorough understanding ofrelational data models including third normal form and fact /dimension designs
  • Change data capture (CDC)design options and application
  • Datamarts
o Oracle database platform featuresincluding indexing partitioning and PL/SQL

oAWS Data Migration System (DMS) Amazon Redshift Aurora PostgresExpertise including but not limited to performance tuning

o Linux O/S commands and scripting

o Secure File Transfer Protocol (SFTP)

o Desire to work in the data integration space(data warehouse data lake AWS data APIs) while continuing to growskill sets

Desired:
Modern development practicese.g. DevOps

Experience with opensource databaseplatforms:
  • PostgreSQL
  • MySQL
  • MariaDB
Data Lake integration design and development (ETL & ELTMethodologies)

Experience with data qualitytools

Experience with AWSplatform:
o DMS

o Glue

o Redshift

o S3 etc

AWS Certifications

Experience in API development

Master datamanagement integration and concepts

Experiencewith job scheduling solutions such as Airflow

Education Bachelors Degree in Computer ScienceThis job has beensourced from an external job board.
More jobson

  • Sr Quality Engineer

    4 weeks ago

    Sany, India GOOD FIVE YES JOB CONSULTANCY Full time

    *Sr Quality Engineer* Exp: 4 8 Yrs Edu: DME/BE Package: 3LPA Loc: Ranipet Skills: Process inspectionQuality Documents Click to Apply : Qualifications and Skills Strong knowledge of precisioninstruments and process inspection Experience in inward inspection and customerquality support Proficiency in quality documentation practices Familiarity...

  • Sr Quality Engineer

    5 days ago

    sany, India GOOD FIVE YES JOB CONSULTANCY Full time

    *Sr Quality Engineer* Exp: 4 8 Yrs Edu: DME/BE Package: 3LPA Loc: Ranipet Skills: Process inspectionQuality Documents Click to Apply : Qualifications and Skills Strong knowledge of precisioninstruments and process inspection Experience in inward inspection and customerquality support Proficiency in quality documentation practices ...

  • Sr Data Engineer

    5 days ago

    sany, India RipplesIndia Group Full time

    Design new processes and builds largecomplex data flows can possess excellent analytical skills andtroubleshooting ideas aware for Agile Mode of operationsopen towork in Devops model.Responsibilities: Design new processes and buildslarge complex data flows Should possessexcellent analytical skills and troubleshooting ideas Should be aware for Agile Mode...

  • Sr Data Engineer

    1 month ago

    Sany, India RipplesIndia Group Full time

    Design new processes and builds largecomplex data flows can possess excellent analytical skills andtroubleshooting ideas aware for Agile Mode of operationsopen towork in Devops model.Responsibilities: Design new processes and buildslarge complex data flows Should possessexcellent analytical skills and troubleshooting ideasShould be aware for Agile Mode of...

  • Data Engineer

    4 weeks ago

    Sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...

  • Sr Data Scientist

    4 weeks ago

    Sany, India Lufthansa Technik Services India Full time

    Rolesand Responsibilities:Successfullydeliver advanced analytics and data science projects withinpredefined timelines and budgetconstraints.Collaboration:Collaborateeffectively with data engineers and ML engineers to comprehend dataand models utilizing various advanced analyticscapabilities.SolutionDevelopment:Developefficient solutions for complex problems...

  • Data Engineer

    1 week ago

    sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...

  • Sr Proposal Engineer

    1 week ago

    sany, India Randstad India Full time

    Position Name Sr . Engg Proposals RoleDescription Proposal & Estimation Engg Position DescriptionExperience Required 4 to 6 yearsQualification BE Mechanical Software knowledge 1. MSOffice 2. Working Experience on SAP/ERP etc. 3. Auto cad 4 Excel 5Drawing access Skills and Competencies 1. Shall be technicallycompetent of fabrication processes such as Welding...

  • Data engineer

    5 days ago

    sany, India HR Aspiration Full time

    Senior Data Engineer Expreine : 3 10Years WorkLocation :Bangalore MandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServer Must HaveExperience: 6 yearsof handson data engineeringexperience Expertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDB Buildingbatch and realtime data pipelines Python SQLcoding for data...

  • Data engineer

    2 weeks ago

    Sany, India HR Aspiration Full time

    Senior Data EngineerExpreine : 3 10Years WorkLocation :BangaloreMandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServerMust HaveExperience:6 yearsof handson data engineeringexperienceExpertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDBBuildingbatch and realtime data pipelinesPython SQLcoding for data processing...

  • Data Engineer

    1 month ago

    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    1 month ago

    sany, India TalentPulse Consultant Full time

    Overview: The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Sr Embedded Software Engineer

    4 weeks ago

    Sany, India Pi Square Technologies Full time

    Job Description PSTI 1609 Client Name CTS Client Location Bangalore Position Name Sr. Embedded Software Engineer InVehicle OverTheAir (OTA) JobDescription Preferred Skills: Bachelors Degree (preferably Masters) in Electrical /Computer Engineering or similar discipline Minimum 10 years of experience in...

  • Sr Embedded Software Engineer

    3 days ago

    sany, India Pi Square Technologies Full time

    Job Description PSTI 1609 Client Name CTS Client Location Bangalore Position Name Sr. Embedded Software Engineer InVehicle OverTheAir (OTA) JobDescription Preferred Skills: Bachelors Degree (preferably Masters) in Electrical /Computer Engineering or similar discipline Minimum 10 years of...

  • Azure Data Engineer

    1 week ago

    sany, India SAM Manpower and Career Services LLP Full time

    Azure Data Engineer with DataVisualization Expert JobDescription JobSummary: We are seeking a skilledSenior Data Engineer with expertise in data visualizationparticularly in Azure Databricks Synapse Power BI and Tableau. Theideal candidate will play a crucial role in designing andoptimizing data architecture implementing ETL processes andcreating...

  • Data Engineer

    4 weeks ago

    Sany, India Bista Univarsal Limited Full time

    Overview:The DataEngineer plays a crucial role in our organization by designingdeveloping and maintaining scalable data architecture for ourdataintensive applications. They work closely with data scientistsanalysts and other stakeholders to ensure efficient data flow andutilization across the organization.KeyResponsibilities:Design andimplement scalable data...

  • Data Engineer

    3 weeks ago

    sany, India Bista Univarsal Limited Full time

    Overview: The DataEngineer plays a crucial role in our organization by designingdeveloping and maintaining scalable data architecture for ourdataintensive applications. They work closely with data scientistsanalysts and other stakeholders to ensure efficient data flow andutilization across the organization.KeyResponsibilities: Design andimplement scalable...

  • Python Data Engineer

    1 week ago

    sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/Developer Exp: 3 YearsRelevant Location: PANIndia Positions: 1 Budget: 15LPA Notice: Immediate joinersonly JD: KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources. Develop manage and...

  • Sr Java Developer

    1 month ago

    sany, India SPG Consulting Full time

    SR Java BS/MSdegree in Computer Science Engineering or a relatedfield solid Java developmentexperience Good knowledge of Java 8API Good knowledge of Java EE Experience with REST API s and Webapplication Security (including design andtesting) Object Oriented analysis and designusing common design patterns. Handsonexperience with major web/application servers...

  • Databricks Data Engineer

    4 weeks ago

    Sany, India BigShyft Full time

    AboutCompany:Our client is aninnovative startup that specializes in data infrastructuresolutions. With a focus on automation and reliability they empowerorganizations to harness the power of their data effectively.Recently acquired their team is expanding and they are seekingtalented individuals to join us in ourmission.JobDescription:As a DatabricksData...