Big Data Engineer
7 days ago
We are looking for Aws big data engineer In Remote , India
Position : Aws big data engineer
Experience : 7 to 9 Year
Location : Remote , India
Mandate skills : BigData Python Pyspark AWS Glue Airflow Redshift
Responsibilities :
- Ensure effective Design, Development, Validation and Support activities in line with client needs and architectural requirements.,
- Ensure continual knowledge management.,
- Adherence to the organizational guidelines and processes.
- As part of the Infosys delivery team, your primary role would be to ensure effective Design, Development, Validation and Support activities,to assure that our clients are satisfied with the high levels of service in the technology domain
- You will gather the requirements and specifications to understand the client requirements in a detailed manner and translate the same into system requirements
- You will play a key role in the overall estimation of work requirements to provide the right information on project estimations to Technology
- Leads and Project Managers
- You would be a key contributor to building efficient programs/ systems and if you think you fit right in to help our clients navigate their next in their digital transformation journey.
- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
- Technical expertise with data models, data mining, and partitioning techniques
- 7-9 years of experience in leading big data engineering projects using
- 7+ years of design & development experience with big data technologies
- Proficient in BigData Python Pyspark AWS Glue Airflow Redshift
- 5+ years of development experience in cloud technologies like Azure, AWS or GCP
- Proficient in querying and manipulating data from various DB (relational and big data).
- Experience of writing effective and maintainable unit and integration tests for ingestion pipelines.
- Experience of using static analysis and code quality tools and building CI/CD pipelines.
- Excellent communication, problem-solving, and leadership skills, and be able to work well in a fast-paced, dynamic environment.
- Experience of working on high-traffic and large-scale Software Products
-
Senior Big Data Engineer
1 month ago
Anywhere in India/Multiple Locations US Technology International Pvt Ltd Full timeJob Title: Senior Big Data EngineerJob Summary:US Technology International Pvt Ltd is seeking a Senior Big Data Engineer to lead the development and implementation of big data solutions. The ideal candidate will have expertise in Hadoop, Spark, and other big data technologies, as well as strong leadership and communication skills.Key Responsibilities:Design,...
-
Big Data Engineer
1 month ago
Anywhere in India/Multiple Locations IT Source Global Full timeJob SummaryWe are seeking a skilled Hadoop Developer to join our team at IT Source Global. As a Hadoop Developer, you will be responsible for designing and developing complex data pipelines for ingestion, transformation, and processing of structured and unstructured data.Key ResponsibilitiesDevelop, implement, and maintain large-scale data processing...
-
Senior Big Data Engineer for Cloud Migration
3 days ago
Anywhere in India/Multiple Locations D-TechWorks Pvt Ltd Full timeAbout the RoleWe are seeking an experienced Senior Big Data Engineer for Cloud Migration to join our team at D-TechWorks Pvt Ltd.Job SummaryThe ideal candidate will have 7-9 years of experience in leading big data engineering projects using AWS, Azure, or GCP. They should be proficient in BigData Python, PySpark, AWS Glue, Airflow, and Redshift.Key...
-
Lead Data Engineer
2 days ago
Anywhere in India/Multiple Locations Talentoj Full timeRequirements : - 6+ years' experience with Big Data Technologies such as Apache Spark, Cloud Native, and Data Lakes, and Databricks. - Delivered ETL/ELT solutions including data extraction, transformation, cleansing, data integration, and data management. - Implemented batch ingestion pipelines. - Strong Python skills - automate tasks, write...
-
Big Data Engineer
3 days ago
Anywhere in India/Multiple Locations TalentXO Full timeRequired Qualifications : - 7-8 years of experience as a Data Engineer or in a similar role - Proficient in Python programming and PySpark for data processing and transformation - Extensive experience in designing and implementing data pipelines using AWS Glue and AWS MWAA (Airflow) - Strong SQL skills, including experience with AWS Redshift -...
-
Senior Big Data Architect
1 week ago
Anywhere in India/Multiple Locations IT Source Global Full timeJob Description:As a Senior Big Data Architect at IT Source Global, you will play a key role in designing and developing large-scale data pipelines using cutting-edge technologies such as Py Spark, Python, and SQL. Your expertise will be instrumental in architecting scalable data lakes, data warehouses, and data marts that meet the evolving needs of our...
-
Big Data Engineer
1 month ago
Anywhere in India/Multiple Locations/Remote Hum Technologies Full timeBig Data Engineer with strong exp in Hadoop, Spark, SQL & AWS for one of the Fortune 500 Clients Company Name : Hum TechnologiesClient : One of the Fortune 500 CompaniesLocation : : Apache NiFi, HDFS, Hive, Impala, Spark, Spark Streaming, Kafka, Java/Scala, SQL, Shell scripting Roles & Responsibilities : - Responsible for designing and implementing...
-
UST - Big Data Engineer
1 week ago
Anywhere in India/Multiple Locations US Technology International Pvt Ltd Full timeJob Description : Responsibilities : 1. Explain and communicate the design / development to the customer 2. Perform and evaluate test results against product specifications 3. Break down complex problems into logical components 4. Develop user interfaces business software components 5. Use data models 6. Estimate time and effort required for...
-
Anywhere in India/Multiple Locations Aexonic Technologies Private Limited Full timeKey Responsibilities :- Design, develop, and optimize Big Data pipelines and workflows using Hadoop, Hive, PySpark, and Google BigQuery.- Architect data solutions to facilitate smooth data migration and processing between on-premises systems and Google Cloud Platform (GCP).- Create and manage Unix Shell Scripts for process automation and data handling...
-
Data Engineer
1 week ago
Anywhere in India/Multiple Locations Orangeskill Technologies Pvt Ltd Full timeJob Description :We are looking for a talented and experienced Data Engineer to join our team. You will be responsible for designing, building, and maintaining data pipelines, workflows, and infrastructure to support efficient data processing and analysis. The ideal candidate will have experience in workflow orchestration tools, database management, data...
-
Data Engineer
1 week ago
Metros/Anywhere in India/Multiple Locations One of the Consulting Firms Full timeData Engineer (Python & SQL)Position : Data Engineer (Python & SQL)Locations : Hyderabad, Chennai, Bengaluru, Mumbai, Pune, Kolkata, GurugramJob Type : Full-TimeCompany : Reputed Big 4 MNC client company of Live Connections.Role Overview :We are looking for a skilled Data Engineer with experience in Python, SQL, and Financial Services Industry (FSI) to join...
-
Cloud Data Engineer
15 hours ago
Anywhere in India/Multiple Locations Excelra Knowledge Solutions Full timeJob Description:Data engineers with expertise in ontologies, cloud platforms, and data technologies are sought after to build scalable data pipelines. The role involves designing, implementing, and managing cloud-based solutions on AWS and Azure.Key Responsibilities:Design and implement cloud infrastructure on AWS and AzureDevelop and optimize data pipelines...
-
Anywhere in India/Multiple Locations/Remote NucleusTeq Consulting Pvt. Ltd. Full timeBig Data Engineer RoleAs a seasoned Big Data Engineer at NucleusTeq Consulting Pvt. Ltd., you will be responsible for leading a team of engineers and driving the implementation of big data solutions. - You will have 5-6 years of experience in big data engineering and a strong exposure to Spark, Scala/Java, Airflow Orchestration, and AWS. - Your expertise...
-
Data Engineer
1 week ago
Anywhere in India/Multiple Locations Crescendo Global Full timeJob Description : Are you an experienced Data Engineer with expertise in Python, Pyspark, and AWS? Our client, a leading technology firm in India, is looking for a Senior Data Engineer to join their team. If you have a strong analytical mindset and a passion for leveraging data to drive business insights, this opportunity is perfect for you.Location : PAN...
-
Excelra - Data Engineer - Python/AWS/Azure
20 hours ago
Anywhere in India/Multiple Locations Excelra Knowledge Solutions Full timeData Engineer (Cloud & Ontologies)Job Description : Excelra is hiring for experienced Data Engineer with expertise in ontologies, AWS, Azure, and various data technologies. The role involves building and maintaining scalable data pipelines, working with cloud platforms, and supporting server and application deployment.Roles and Responsibilities : - Cloud...
-
Big Data Solutions Architect
1 month ago
Anywhere in India/Multiple Locations/Hyderabad/Srinagar/Jaipur Aricent Full time**Job Title:** Big Data Solutions Architect**Job Description:**At Aricent, we are looking for a skilled Data Engineer to design and build large-scale Hadoop and NoSQL database solutions for our Fortune 500 clients. The ideal candidate will have extensive experience in PySpark and the ability to integrate data across internal and external sources, providing...
-
Big Data Engineer
3 weeks ago
India Pert Telecom Solutions Full timeJob Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential...
-
Data Engineer
1 week ago
Anywhere in India/Multiple Locations Innotatz IT Solutions Full timeJob Description : We are looking for candidates who can join immediately. InnotatzIT Solutions is a global Software Development, IT Product Design and IT Consulting Company predominantly focused on Web Application Development, Digital Innovations & IT Recruitment Solutions. We also provide global digital consultancy that helps brands leverage design,...
-
Data Engineer
2 days ago
Anywhere in India/Multiple Locations Info Services Full timeResponsibilities :- Data Ingestion & Processing : Design and implement efficient data pipelines using big data frameworks (e.g, Spark) for ingesting, transforming, and processing large datasets.- Programming Powerhouse : Utilize your strong coding skills in Scala (preferred), Python, or Java to develop high-performance and scalable data processing...
-
Azure Data Engineer
1 month ago
Anywhere in India/Multiple Locations Prep Full timeJob Description : The ideal candidate will design, architect, and develop end-to-end data solutions on the Azure Stack platform. They will implement and optimize data pipelines, ETL processes, and data integration solutions using Azure Data Factory, Azure Data Lake, Azure Databricks, Azure SQL Database, and other relevant Azure services. Collaboration with...