Big Data Engineer
6 months ago
Role : Big Data Engineer
About Organization :
Our Client is an IT consulting organization focused on providing AI Led Digital Transformation Consulting services to enterprise customers. They have adopted AI First strategy to drive value in form of Agility, Quality, Efficiency, Competitive advantage, Customer experience as core principles. Our focus is to drive data driven decision culture by analyzing vast amount of amount at scale.
Mentorship and enablement is the core culture of the organization, we believe in "The only way to do great work is to love what you do."
Role Description :
- Data modeling and architecture: You would be responsible for designing and implementing data models that are optimized for Azure services, including Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage.
- ETL and data integration: You would be responsible for building and maintaining data pipelines that move data from various sources into Azure, transform the data as necessary, and load it into Azure data stores.
- Data analysis and reporting: You would be responsible for designing and building data analysis and reporting solutions on Azure, using tools such as Azure Analysis Services, Power BI, and Excel.
- Performance tuning and optimization: You would be responsible for monitoring and tuning the performance of Azure data solutions, ensuring that they meet the required performance and scalability requirements.
- Security and compliance: You would be responsible for implementing security and compliance controls for Azure data solutions, including access controls, encryption, and data masking.
- Collaboration and communication: You would work closely with other members of the data engineering team, as well as with stakeholders in other departments, to ensure that Azure data solutions meet business requirements and are integrated into the wider technology landscape.
Required Qualifications :
- Degree in computer science, information technology, or a related field
- Experience with technologies such as Data Lake, SQL, PostgreSQL, Spark, and Azure Data Explorer
- Proficiency in programming languages such as Scala, Java or Python, and experience with distributed computing and database systems.
- Strong problem-solving and analytical skills, as well as excellent communication and collaboration skills, are also important for success in this role.
- Industry experience: 4 Years to 7 years
- Engineers needs to be self-motivated and objective driven.
- He/She should be ready to learn new domain and technology based on organization strategy.
Location : Pune
-
Data Engineer
1 month ago
Pune, Maharashtra, India NTT DATA Services Full timeJob Title: Data Engineer - Big Data SpecialistWe are seeking a highly skilled Data Engineer to join our team in Pune, India. As a Data Engineer, you will work on exciting big data related projects that require large data sets to be processed via a vendor sourced solution on a daily, weekly and monthly basis.Key Responsibilities:Analyzing data sets and...
-
Data Engineer
3 weeks ago
Pune, Maharashtra, India Virtusa Full timeAbout the RoleAt Virtusa, we are seeking a highly skilled Data Engineer (Big Data) to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Apache Spark, Hadoop, and Hive.Responsibilities• Design, develop, and...
-
Senior Big Data Developer
2 weeks ago
Pune, Maharashtra, India NTT DATA Full timeCompany OverviewNTT DATA is a global technology services company that helps clients innovate, optimize and transform for long term success. We have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our Commitment to YouEstimated Salary: ₹2,200,000 - ₹3,500,000 per annum (dependent on...
-
Senior Big Data Engineer
4 weeks ago
Pune, Maharashtra, India Virtusa Full timeAbout the RoleAt Virtusa, we are looking for a skilled Senior Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark, Hadoop, Hive, and Impala.Key Responsibilities• Develop and implement data pipelines using...
-
Big Data Engineer
1 month ago
Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full timeJob SummaryF337 Deutsche India Private Limited, Pune Branch is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Scala technologies.Key ResponsibilitiesDesign and develop data processing pipelines using...
-
Data Engineer
3 weeks ago
Pune, Maharashtra, India NR Consulting - India Full timeJob Title: Data Engineer - Java and Big DataJob Description:Data Engineer - Java and Big DataPython – advanced concepts (add on if candidate have Java background)Problem SolvingHadoop/Spark/HiveKafkaSpring Boot PL/SQL – derive a pseudocode, write a queryAbout the Role:This role requires a strong background in Java and Big Data technologies. The ideal...
-
Big Data Engineer/Manager
1 month ago
Pune, Maharashtra, India Huquo Full timeJob Overview :Huquo is seeking a highly skilled Data Architect and Engineer to lead our data engineering team. As a key member of our team, you will design and implement scalable, secure, and high-performance data architectures.Key Responsibilities :Design and develop data pipelines using Hadoop, Spark, and other big data technologies.Collaborate with...
-
Data Engineer Lead
3 weeks ago
Pune, Maharashtra, India DATAECONOMY Full timeJob Profile:At DATAECONOMY, we are seeking a highly skilled Data Engineer Lead to lead our team in designing and implementing big data solutions using PySpark. As a key member of our team, you will be responsible for collaborating with cross-functional teams to understand business needs and develop data-driven solutions.Key Responsibilities:Design and...
-
Scalable Big Data Engineer
6 days ago
Pune, Maharashtra, India Virtusa Full timeJob Title: Scalable Big Data EngineerAbout the RoleVirtusa is seeking an experienced Scala and Spark Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Scala and Spark.Key Responsibilities- Design and develop scalable big data...
-
Data Engineer
4 weeks ago
Pune, Maharashtra, India NTT DATA Full timeJob Title:Data EngineerJob Summary:NTT DATA is seeking a Data Engineer to join our team in Pune, India. The successful candidate will have demonstrable experience and expertise in at least one programming language, whether it's Python, Java, Scala, or another technology. We value attitude and aptitude and are seeking bright, highly motivated individuals to...
-
Data Engineer Leader
4 weeks ago
Pune, Maharashtra, India DATAECONOMY Full timeAbout the RoleDataEconomy is seeking a Senior Data Engineer to lead our team in designing and implementing big data solutions using PySpark.Key ResponsibilitiesLead the design and implementation of scalable and robust data pipelines using PySpark.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Mentor and...
-
Big Data Engineer
4 weeks ago
Pune, Maharashtra, India PRI Global Full timeJob Title: Big Data Engineer - Data Migration SpecialistJob Summary: We are seeking a highly skilled Big Data Engineer to join our team at PRI Global. As a Big Data Engineer - Data Migration Specialist, you will be responsible for migrating data from HDFS to Ozone, ensuring seamless data transfer and minimizing downtime.Key Responsibilities:Migrate data from...
-
Senior Big Data Engineer
1 month ago
Pune, Maharashtra, India Xoriant Full timeJob OverviewXoriant is seeking a highly skilled Senior Big Data Engineer to join our team. The ideal candidate will have expertise in Apache Spark and Scala, with a strong background in big data processing and analytics.Key ResponsibilitiesDesign and develop scalable big data architectures using Apache SparkDevelop and maintain high-performance data...
-
Big Data Engineer
2 months ago
Pune, Maharashtra, India Mig Staffing Full timeWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.To ensure success as a big data...
-
Senior Data Engineer
4 weeks ago
Pune, Maharashtra, India Data Axle Full timeAbout Data Axle Data Axle Inc. has been a leading provider of data, marketing solutions, sales and research for decades in the US. We have established a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers through our proprietary cloud-based technology platform and leveraging our proprietary...
-
Big Data Cloud Engineer
4 weeks ago
Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full timeAbout the RoleWe are seeking a motivated Big Data Cloud Engineer to join our team at F337 Deutsche India Private Limited, Pune Branch. This role will be part of the Technology, Data and Innovation (TDI) department, working on the central client reference data system in Germany.Key ResponsibilitiesDesign and implement big data solutions using Cloudera,...
-
Senior Big Data Engineer
4 weeks ago
Pune, Maharashtra, India PubMatic Full timeWe are seeking a highly skilled Senior Big Data Engineer to join our team at PubMatic-Pune.Key Responsibilities:Design, implement, and deliver complex, scalable, and resilient big data platforms and services.Develop and maintain high-throughput big data platforms using modern technology stacks such as Apache Spark, Apache Kafka, and Hadoop.Collaborate with...
-
Big Data Engineer
2 months ago
Pune, Maharashtra, India Mig Staffing Full timeJob Description : We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production :- Meeting with managers to...
-
Senior Data Engineer
2 weeks ago
Pune, Maharashtra, India TapTalent Full timeTapTalent is a leading player in the job market, and we're looking for a seasoned Data Engineer to join our team. As a senior member of our engineering team, you will play a crucial role in designing and developing our big data platform.We're looking for someone with at least 4 years of experience in working with Scala Spark. If you have expertise in data...
-
Data Engineer
1 month ago
Pune, Maharashtra, India Virtusa Full timeJob Title: Senior Data Developer - ClouderaJob Summary: We are seeking a highly skilled Senior Data Developer to join our team at Virtusa. The ideal candidate will have a strong background in big data technologies, including Apache Spark, Hadoop, Hive, and Impala.Key Responsibilities:Design and develop scalable big data solutions using Apache Spark and...