Data Engineer
1 month ago
Responsibilities :
- Design and implement scalable and efficient data pipelines using Spark, PySpark, and Hive.
- Optimize data ingestion, transformation, and loading processes for performance and cost-effectiveness.
- Ensure data quality, consistency, and security across the data platform.
- Troubleshoot and resolve complex data-related issues.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
- Provide technical leadership and mentorship to the data engineering team.
- Leverage cloud platforms (Azure preferred) for data storage and processing.
- Implement data governance and compliance policies.
Required Skills and Experience :
- 8-10 years of experience in data engineering and development.
- Strong proficiency in Scala, Python, Spark, and Hive.
- In-depth understanding of Hadoop ecosystem and distributed computing concepts.
- Experience with data modeling and data warehousing concepts.
- Proficiency in SQL and database management systems.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration skills.
Preferred Skills :
- Experience with Azure data services (Data Factory, Data Lake, Synapse Analytics).
- Knowledge of machine learning and AI concepts.
- Experience with data visualization tools (Power BI, Tableau).
- Certifications in cloud platforms or data engineering
-
Azure Data Architect
5 months ago
Remote, India Data PlatformExperts Full timeJob Description: Azure Data Engineer (Architect Level) We are seeking an experienced and highly skilled Azure Data Engineer at the Architect level to lead the design and implementation of complex data solutions on the Microsoft Azure platform. As an Azure Data Engineer Architect, you will be responsible for providing technical expertise, guiding the...
-
Azure Data Architect
5 months ago
Remote, India Data PlatformExperts Full time**Job Description: Azure Data Architect** **Key Responsibilities**: - **Design and Implementation**: - Design and implement end-to-end data solutions (data models, pipelines, data lakes, data warehouses) in Azure. - Optimize and maintain existing Azure data structures and integration processes. - Ensure architectural solutions are scalable, maintainable,...
-
Senior Java Engineer
2 weeks ago
Remote, India Data caliper Full timeJob Title: Senior Java EngineerAbout the Role:Data Caliper is seeking a highly skilled Senior Java Engineer to lead the development of our Java-based applications. The successful candidate will have a deep understanding of Java programming principles and will be able to design, develop, and maintain robust and scalable Java applications.Key...
-
Data Engineer
3 weeks ago
Remote, India CodeKart Full timeJob Title: Data EngineerAt CodeKart, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines using AWS services such as EMR, Glue, and Lambda.Develop and maintain data...
-
Data Engineer
4 weeks ago
Remote, India Glow Touch Full timeJob Title: Data EngineerWe are seeking a skilled Data Engineer to join our dynamic team at GlowTouch Technologies. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures that support our data-driven decision-making processes.Key Responsibilities:Design, develop, and maintain robust data...
-
Data Engineer
3 weeks ago
Remote, India Abs Group Full timeJob Title: Data EngineerAt Abs Group, we are seeking an experienced Data Engineer to play a crucial role in our fintech data lake project.Key Responsibilities:Design and implement data ingestion pipelines from Oracle Fusion Cloud to a Data Bricks environment.Develop and maintain data transformation/ETL skills using Spark SQL, Spark, and Unity Catalog in Data...
-
Data Engineer
4 weeks ago
Remote, India Prime Infosoft Full timeJob Title: Data EngineerAbout the Role:We are seeking a skilled Data Engineer to join our team at Prime Infosoft. As a Data Engineer, you will play a crucial role in designing and implementing data pipelines using Apache Spark and AWS services. Your work will involve developing, testing, and maintaining scalable data architectures, ensuring data quality and...
-
Data Engineer
3 weeks ago
Remote, India ThinkMove Solutions Full timeCompensation: ₹14 - ₹18 LPA Overview:We are seeking a skilled and experienced Data Engineer with a specialization in DataBricks to drive our data infrastructure forward. As a Data Engineer, you will play a pivotal role in designing, implementing, and maintaining our data infrastructure, with a specific focus on leveraging DataBricks for data processing...
-
Data Engineer
3 weeks ago
Remote, India Miratech Full timeJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Miratech. As a key member of our data engineering team, you will be responsible for designing, implementing, and deploying scalable data pipelines using Big Data technologies.Key Responsibilities:Design and implement data pipelines using Azure Cloud, Databricks, and...
-
Data Engineer
3 weeks ago
Remote, India Informica Full timeJob Title: Data EngineerWe are seeking an experienced Data Engineer to play a crucial role in our fintech data lake project.Key Responsibilities:Design and implement data ingestion pipelines from Oracle Fusion Cloud to a Databricks environment.Develop strong data transformation/ETL skills using Spark SQL, Pyspark, and Unity Catalog in Databricks Medallion...
-
Data Engineer
3 weeks ago
Remote, India Abs Group Full timeJob Title: Data EngineerAt Abs Group, we are seeking an experienced Data Engineer to play a crucial role in our fintech data lake project. The ideal candidate will have a strong background in data warehousing systems, Oracle Fusion ecosystem, and big data environments.Key Responsibilities:Design and develop data ingestion pipelines from Oracle Fusion Cloud...
-
Data Engineer
3 weeks ago
Remote, India Cloudcover Consultancy Private Limited Full timeJob OverviewThe Data Engineer will be responsible for designing and building modern data platforms to support data-driven decision making. The Data Engineer will execute technical implementation of data engineering and visualization projects.Key ResponsibilitiesDesign, implement, and develop data pipelines to collect and process large amounts of data from...
-
Data Engineer
3 weeks ago
Remote, India Miratech Full time{"title": "Middle Data Engineer", "description": "Job SummaryWe are seeking a skilled Middle Data Engineer to join our company remotely. This role is a key member of one of our specialized teams, responsible for overseeing the development and deployment processes.Key ResponsibilitiesManage and optimize automated pipelines to ensure the seamless delivery of...
-
Data Engineer
3 weeks ago
Remote, India Cloudcover Consultancy Private Limited Full timeJob OverviewThe Data Engineer will be responsible for designing and building modern data platforms to support data-driven decision making. The Data Engineer will execute technical implementation of data engineering and visualization projects.Key ResponsibilitiesDesign, implement, and develop data pipelines to collect and process large amounts of data from...
-
Data Engineer
2 weeks ago
Remote, India EXO EDGE INDIA LLP Full timeAt EXO EDGE INDIA LLP, we are seeking a skilled Data Engineer to oversee the design, development, and evaluation of data infrastructures. As a Data Engineer, you will be responsible for ensuring the accuracy, reliability, and consistency of data, as well as developing data visualizations and reports to facilitate business decision-making.Key responsibilities...
-
Data Engineer
1 month ago
Remote, IN Comtek Solution Full timeAbout us : The Big data engineer will be responsible for the building of critical data infrastructure that surfaces data and insight and be the face to the data user community.You can analyze and test changes to our data architectures and processes and determine what the possible downstream effects and potential impacts to our data consumers,SUMMARY OF...
-
Data Engineer
4 weeks ago
Remote, India Comtek Solution Full timeAbout us : The Big data engineer will be responsible for the building of critical data infrastructure that surfaces data and insight and be the face to the data user community. You can analyze and test changes to our data architectures and processes and determine what the possible downstream effects and potential impacts to our data consumers, SUMMARY OF...
-
Data Engineer
3 weeks ago
Remote, India Glow Touch Full timeJob Title: Data Engineer - Scalable Data PipelinesOverview: We are seeking a skilled Data Engineer to join our dynamic team at GlowTouch Technologies. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures that support our data-driven decision-making processes.Key Responsibilities:Design,...
-
Azure Data Engineer
4 weeks ago
Remote, India Racrosoft Technologies Full timeJob Title: Azure Data EngineerAbout the Role:We are seeking an experienced Azure Data Engineer to join our team at Racrosoft Technologies. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on Azure.Key Responsibilities:- Design and implement data pipelines using...
-
Data Engineer
2 weeks ago
Remote, India Nthinsight Full timeData Infrastructure ExpertiseAt Nthinsight, we seek a skilled and experienced Data Engineer to join our dynamic and innovative team. As a key member of our data infrastructure team, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data needs. You will collaborate with...