Data Engineer Developer
4 weeks ago
- Designing andimplementing robust ETL processes using Databricks andSpark
- Developing and optimizing data pipelinesfor largescale data processing
- Collaboratingwith data engineers and data scientists to support their datainfrastructure needs
- Building and maintainingdata warehouse solutions to support businessanalytics
- Performing data modeling andoptimization to ensure efficient data storage andretrieval
- Troubleshooting and resolvingperformance issues with data infrastructure andpipelines
- Implementing security and datagovernance best practices within the dataplatform
- Automating data quality checks andensuring data consistency andaccuracy
- Collaborating with crossfunctionalteams to understand data requirements and deliversolutions
- Monitoring and maintaining the healthof data pipelines andinfrastructure
- Documenting technical design andarchitecture of data solutions
- Participating incode reviews and providing constructive feedback topeers
- Staying updated with the latestadvancements in Databricks and Sparktechnologies
- Providing technical guidance andmentorship to junior teammembers
- Bachelors degree inComputer Science Engineering or a relatedfield
- Proven experience in developing datapipelines using Databricks andSpark
- Proficiency in ETL processes and datawarehousing concepts
- Strong SQL skills with theability to write complex queries for data manipulation andanalysis
- Advanced programming skills in Pythonfor data processing and manipulation
- Experiencein data modeling and optimizing data storage forperformance
- Deep understanding of big datatechnologies and distributed computingconcepts
- Ability to troubleshoot and optimizedata pipeline performance for efficiency andreliability
- Knowledge of data governancesecurity and compliance bestpractices
- Excellent communication andcollaboration skills to work effectively in a teamenvironment
- Strong analytical andproblemsolving abilities to tackle complex data engineeringchallenges
- Ability to multitask and prioritizetasks in a fastpaced and dynamic workenvironment
- Experience with cloud platformssuch as AWS Azure or GCP is aplus
- Certifications in Databricks andSparkrelated technologies aredesirable
- Experience in Agile developmentmethodologies and version controlsystems
ExperienceRequired:Data Engineeringresource with Databricks (Databricks develops a webbased platformfor working with Spark) experience with Python coding background& SQL
data,spark,datagovernance,data modeling,python,brick
-
Data Engineer
4 weeks ago
Sany, India TalentPulse Consultant Full timeOverview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...
-
Data Engineer
4 weeks ago
sany, India TalentPulse Consultant Full timeOverview: The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...
-
Data engineer
5 days ago
sany, India HR Aspiration Full timeSenior Data Engineer Expreine : 3 10Years WorkLocation :Bangalore MandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServer Must HaveExperience: 6 yearsof handson data engineeringexperience Expertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDB Buildingbatch and realtime data pipelines Python SQLcoding for data...
-
Data engineer
2 weeks ago
Sany, India HR Aspiration Full timeSenior Data EngineerExpreine : 3 10Years WorkLocation :BangaloreMandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServerMust HaveExperience:6 yearsof handson data engineeringexperienceExpertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDBBuildingbatch and realtime data pipelinesPython SQLcoding for data processing...
-
Data Engineer
4 weeks ago
Sany, India BTOSC Infotech Full timeWe are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...
-
Data Engineer
1 week ago
sany, India BTOSC Infotech Full timeWe are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...
-
Python Data Engineer
1 week ago
sany, India SAM Manpower and Career Services LLP Full timeRole: Python DataEngineer/Developer Exp: 3 YearsRelevant Location: PANIndia Positions: 1 Budget: 15LPA Notice: Immediate joinersonly JD: KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources. Develop manage and...
-
Data Engineer
3 weeks ago
sany, India Bista Univarsal Limited Full timeOverview: The DataEngineer plays a crucial role in our organization by designingdeveloping and maintaining scalable data architecture for ourdataintensive applications. They work closely with data scientistsanalysts and other stakeholders to ensure efficient data flow andutilization across the organization.KeyResponsibilities: Design andimplement scalable...
-
Data Engineer
4 weeks ago
Sany, India Bista Univarsal Limited Full timeOverview:The DataEngineer plays a crucial role in our organization by designingdeveloping and maintaining scalable data architecture for ourdataintensive applications. They work closely with data scientistsanalysts and other stakeholders to ensure efficient data flow andutilization across the organization.KeyResponsibilities:Design andimplement scalable data...
-
Azure Data Engineer
3 weeks ago
sany, India Zerozilla Full timeNo. of Position: 2 Position: Azure Data Engineer Exp: 58Years Location: Bangalore Hybrid NP: Only Immediate/15 Days Mandatoryskills: ADF ADB Azure Synapse analytics. JD: There is a client round for this position. Hence look fortechnically hands on candidates for this role. Job Description:Essential Skills Synapse/ Azure SQL DWH Data Modelling &...
-
Azure Data Engineer
4 weeks ago
Sany, India Zerozilla Full timeNo. of Position: 2Position: Azure Data Engineer Exp: 58Years Location: Bangalore HybridNP: Only Immediate/15 Days Mandatoryskills: ADF ADB Azure Synapse analytics. JD: There is a client round for this position. Hence look fortechnically hands on candidates for this role. Job Description:Essential Skills Synapse/ Azure SQL DWH Data Modelling & Thereis an...
-
Consultant Data Engineering
19 hours ago
Sany, India Tekwissen India Full timeOverview TekWissen Group isa workforce management provider operating throughout India andseveral other countries worldwide. The client below is a leadingtechnology company offering a range of IT solutions to businessesand organizations enabling them to transform their digital futures Position: ConsultantData Engineering Location: Bangalore ...
-
AWS Data Engineer
1 week ago
sany, India TalentPulse Consultant Full timeOverview: The AWS DataEngineer plays a crucial role in our organization by designing andimplementing scalable reliable and secure data solutions in the AWScloud environment. They are responsible for developing andmaintaining data pipelines optimizing data workflows and ensuringthe quality and integrity of our data. This position is essentialfor leveraging...
-
Azure Data Engineer
7 days ago
sany, India SAM Manpower and Career Services LLP Full timeAzure Data Engineer with DataVisualization Expert JobDescription JobSummary: We are seeking a skilledSenior Data Engineer with expertise in data visualizationparticularly in Azure Databricks Synapse Power BI and Tableau. Theideal candidate will play a crucial role in designing andoptimizing data architecture implementing ETL processes andcreating...
-
Databricks Data Engineer
4 weeks ago
Sany, India BigShyft Full timeAboutCompany:Our client is aninnovative startup that specializes in data infrastructuresolutions. With a focus on automation and reliability they empowerorganizations to harness the power of their data effectively.Recently acquired their team is expanding and they are seekingtalented individuals to join us in ourmission.JobDescription:As a DatabricksData...
-
SeniorStaff Data Warehouse Engineer
6 days ago
sany, India Talentxo Full timeAbout theCompany: We are hiring for amidsized technology company focused on improving recruitmentprocesses through innovative technology solutions. Their mission isto empower recruiters with the tools and resources they need tofind and hire top talentefficiently.JobDescription: We are seeking aSenior/Staff Data Warehouse Engineer Data Engineering to join...
-
Data Engineer
4 hours ago
sany, India Agilite Global Solutions Company Full timeRole: DataEngineer Location: India Remote Work from Anywhere inIndiaMinimum Qualification: B. Tech. or equivalent from an accreditedinstitutionIndicativeExperience: 6YearsDomain: USHealthCare.Customer Profile: Captive research and development pods for a 500millionmember group of pharma data research companies that helppatients gain access to lifesaving...
-
GCP Data Engineer
3 weeks ago
Sany, India AugmntX Full timeShift Time: 129 pm / 110 pmISTJobDescription:Please find below the highlevelresponsibilities (not just limited to below). This is a migrationproject from Snowflake to GCP Big Query however the components inAzure need to be migrated to equivalent GCP components aswell.Experience: 6yearsKeyResponsibilities: Work closely with the dataengineering and analytics...
-
GCP Data Engineer
1 week ago
sany, India AugmntX Full timeShift Time: 129 pm / 110 pmISTJobDescription:Please find below the highlevelresponsibilities (not just limited to below). This is a migrationproject from Snowflake to GCP Big Query however the components inAzure need to be migrated to equivalent GCP components aswell.Experience: 6yearsKeyResponsibilities: Work closely with the dataengineering and analytics...
-
Data Migration Engineer
7 days ago
sany, India Randstad India Full timeDescription: Data Migration EngineerRole andResponsibilities:Work with the customer userstechnical architect and application designers to define the datamigration requirements and structure for theapplication.Lead the data migration plan analysisdesign and build effort.Work with the technicalarchitects and application designers to understand the...