Big Data/Python/PySpark/Kafka | Consultant/ Sr Consultant/ Manager
4 weeks ago
What impact will you make?
Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is where you’ll find unrivaled opportunities to succeed and realize your full potential
Deloitte is where you’ll find unrivaled opportunities to succeed and realize your full potential.
The Team
The world of business, economics, and finance is rapidly changing. Trends in the economy affect businesses, industries, and the financial markets that interact with one another in dynamic and often unpredictable ways. The Deloitte Industry team is focused on analysing economic and industry developments in India and their relevance to businesses. The team is responsible for conducting path-breaking and innovative research, analyse trends, and develop in-depth business and industry/sector thought leaderships that provide useful insights to enable business teams/partners to make strategic decisions.
Work you’ll do
In our Consulting team, you’ll build and nurture positive working relationships with teams and clients with the intention to exceed client expectations. You’ll:
- develop and deploy solutions using different tools, design principles and conventions.
- large, complex data sets that meet functional / non-functional business requirements.
- design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources and ‘big data’ technologies.
- data ingestion and processing performance by tuning configuration parameters, optimizing SQL queries, and implementing parallel processing techniques.
- pipeline performance and resource utilization to identify bottlenecks and optimize system resources allocation.
- up monitoring and alerting systems to track pipeline health, detect anomalies, and notify stakeholders of potential issues or failures.
- logging and metrics collection to facilitate troubleshooting and performance analysis.
- existing processes and facilitate change requirements as part of a structured change control process.
- proper documentation for the solutions, test procedures and scenarios during UAT and Production phase.
- and implement Pipeline Development, Data Quality and Governance, Monitoring and Alerting, Data Virtualization and Query Optimization, Data Source Integration, Data Catalog Management, Security and Access Control, Integration with Applications and Ecosystems, Data Ingestion and Management
- with process owners and business to understand the as-is process and design the automation process flow.
- high-quality code resulting from knowledge of the latest frameworks, code peer review, and automated unit test scripts.
- with other developers and team members.
- in Agile ceremonies such as sprint planning, daily stand-ups, and retrospective meetings Develop and document unit tests and execute all processes and procedures in assigned areas of responsibility.
Qualifications
3-12 years of relevant hands-on experience on any or all the Airbyte/Dremio/MinIO tools.
3-12 years of relevant hands-on experience on Big Data Ecosystem – on Premise or Cloud version.
3-12 years of relevant experience in consulting industry, or technology experience for big data.
Turn information into insight for improved business performance by consulting with architects, solution managers, and analysts to understand business technical needs and deliver solutions.
Design, create, code, and support a variety of Big Data ETL solutions (potentially including but not limited to: Python, SPARK Scala, Kafka, Different Data Services, Informatica, Talend, or others).
Create and maintain development patterns, standards, processes, and norms. Analyze existing processes and user development requirements to ensure maximum efficiency.
Demonstrate the ability to build a work plan or parts of a work plan, as applicable for role.
Implementation of medium/large projects.
Work with the team to design, code, and test ETL or ELT solutions for the reference architecture.
Experience with object-oriented/object function scripting languages: Python/Scala, SQL, Spark-SQL.
Proficient in Shell Scripts.
Embrace a Continuous Improvement mentality to streamline and eliminate waste in all processes.
Demonstrate initiative and ownership by proactively resolving issues and taking on multiple work plan tasks.
Effective communications with both technical and business communities.
Maintain strong technical skills and share knowledge with team members.
Strong problem solving and troubleshooting skills.
Willingness to travel up in case of project requirement.
Working knowledge of agile methodologies.
Benefits
At Deloitte, we know that great people make a great organization. We value our people and offer employees a broad range of benefits. Learn more about what working at Deloitte can mean for you.
Our purpose
Deloitte is led by a purpose: To make an impact that matters.
Every day, Deloitte people are making a real impact in the places they live and work. We pride ourselves on doing not only what is good for clients, but also what is good for our people and the communities in which we live and work—always striving to be an organization that is held up as a role model of quality, integrity, and positive change. Learn more about Deloitte's impact on the world
-
Bhubaneshwar, India Deloitte Full timeWhat impact will you make?Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is where you’ll find unrivaled opportunities to succeed and realize your full potentialDeloitte is where you’ll find unrivaled...
-
Bhubaneshwar, India Deloitte Full timeWhat impact will you make?Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance. As the undisputed leader in professional services, Deloitte is where you will find unrivaled opportunities to succeed and realize your full potential.Deloitte is where you will find...
-
Bhubaneshwar, India Deloitte Full timeWhat impact will you make?Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance. As the undisputed leader in professional services, Deloitte is where you will find unrivaled opportunities to succeed and realize your full potential.Deloitte is where you will find...
-
GCP | Consultant/ Sr Consultant/ Manager
4 weeks ago
Bhubaneshwar, India Deloitte Full timeWhat impact will you make?Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is where you’ll find unrivaled opportunities to succeed and realize your full potentialDeloitte is where you’ll find unrivaled...
-
GCP | Consultant/ Sr Consultant/ Manager
2 months ago
Bhubaneshwar, India Deloitte Full timeWhat impact will you make?Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is where you’ll find unrivaled opportunities to succeed and realize your full potentialDeloitte is where you’ll find unrivaled...
-
Senior Consultant
2 weeks ago
Bhubaneshwar, Odisha, India HighRadius Full timeAbout Us HighRadius, a renowned provider of cloud-based Autonomous Software for the Office of the CFO, has transformed critical financial processes for over 800+ leading companies worldwide. Trusted by prestigious organizations like 3M, Unilever, Anheuser-Busch InBev, Sanofi, Kellogg Company, Danone, Hershey's, and many others, HighRadius optimizes...
-
Informatica IDQ| Consultant
4 weeks ago
Bhubaneshwar, India Deloitte Full timeWhat impact will you make?Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is where you’ll find unrivaled opportunities to succeed and realize your full potentialDeloitte is where you’ll find unrivaled...
-
Informatica IDQ| Consultant
2 months ago
Bhubaneshwar, India Deloitte Full timeWhat impact will you make?Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is where you’ll find unrivaled opportunities to succeed and realize your full potentialDeloitte is where you’ll find unrivaled...
-
Sales Consultant
2 weeks ago
Bhubaneshwar, Odisha, India SearchingYard Group Full timeCompany OverviewWelcome to SearchingYard! At SearchingYard, we are trailblazers shaping the future, leading the charge in cutting-edge technologies. Our team of specialists is committed to pushing boundaries in the fields of Internet of Things (IoT), Artificial Intelligence (AI), Machine Learning (ML), and Augmented Reality/Virtual Reality (AR/VR). We thrive...
-
Hadoop Developer
1 month ago
Bhubaneshwar, Odisha, India Cognizant Full timeBig data Developer - Spark,Scala,SQL,AWS,Kafka,Java4+ Years of experience in Bigdata development. 4+ Years in SQL/PLSQL 4+ Years of experience in Unix. 3+ Years of experience in spark with Scala/Python. 3+ years of experience in AWS (EMR, GLUE, EC2, Athena, Redshift, Lambda, RDS, S3, Sagemaker, NeptuneDB, etc) 2+ Years of experience in Kafka. Performance...
-
Hadoop Developer
2 weeks ago
Bhubaneshwar, Odisha, India Cognizant Full timeBig data Developer - Spark,Scala,SQL,AWS,Kafka,Java4+ Years of experience in Bigdata development. 4+ Years in SQL/PLSQL 4+ Years of experience in Unix. 3+ Years of experience in spark with Scala/Python. 3+ years of experience in AWS (EMR, GLUE, EC2, Athena, Redshift, Lambda, RDS, S3, Sagemaker, NeptuneDB, etc) 2+ Years of experience in Kafka. Performance...
-
Hadoop Developer
4 weeks ago
Bhubaneshwar, Odisha, India Cognizant Full timeBig data Developer - Spark,Scala,SQL,AWS,Kafka,Java4+ Years of experience in Bigdata development. 4+ Years in SQL/PLSQL 4+ Years of experience in Unix. 3+ Years of experience in spark with Scala/Python. 3+ years of experience in AWS (EMR, GLUE, EC2, Athena, Redshift, Lambda, RDS, S3, Sagemaker, NeptuneDB, etc) 2+ Years of experience in Kafka. Performance...
-
Data Scientist
1 month ago
Bhubaneshwar, India Talent Socio Full timeResponsibilities :- Data Collection and Cleaning : Gather and process data from various sources, ensuring data quality and consistency.- Data Exploration : Explore and visualize data to understand patterns, trends, and anomalies.- Statistical Analysis : Apply statistical methods to extract meaningful insights from data, such as hypothesis testing, regression...
-
Data Scientist
1 month ago
Bhubaneshwar, India Talent Socio Full timeResponsibilities :- Data Collection and Cleaning : Gather and process data from various sources, ensuring data quality and consistency.- Data Exploration : Explore and visualize data to understand patterns, trends, and anomalies.- Statistical Analysis : Apply statistical methods to extract meaningful insights from data, such as hypothesis testing, regression...
-
Data Scientist
4 weeks ago
Bhubaneshwar, India Talent Socio Full timeResponsibilities :- Data Collection and Cleaning : Gather and process data from various sources, ensuring data quality and consistency.- Data Exploration : Explore and visualize data to understand patterns, trends, and anomalies.- Statistical Analysis : Apply statistical methods to extract meaningful insights from data, such as hypothesis testing, regression...
-
Data Scientist
4 weeks ago
Bhubaneshwar, India Talent Socio Full timeResponsibilities :- Data Collection and Cleaning : Gather and process data from various sources, ensuring data quality and consistency.- Data Exploration : Explore and visualize data to understand patterns, trends, and anomalies.- Statistical Analysis : Apply statistical methods to extract meaningful insights from data, such as hypothesis testing, regression...
-
Java Full stack | Consultant/ Sr Consultant
4 weeks ago
Bhubaneshwar, India Deloitte Full timeWhat impact will you make?Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is where you’ll find unrivaled opportunities to succeed and realize your full potentialDeloitte is where you’ll find unrivaled...
-
Java Full stack | Consultant/ Sr Consultant
2 months ago
Bhubaneshwar, India Deloitte Full timeWhat impact will you make?Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is where you’ll find unrivaled opportunities to succeed and realize your full potentialDeloitte is where you’ll find unrivaled...
-
Virtual Wal-in@ Data Engineer@ 10th Feb
2 weeks ago
Bhubaneshwar, Odisha, India Muvi Full timeData Engineer - Python, BigData:We are hiring Data Engineer to join Muvi's growing Engineering team. You will be working on some latest and greatest technology stack like Big Data implementation using Python. To be successful at this role, you should be a self driven problem solver and excellent coder.Responsibilities: Create and maintain optimal data...
-
Python Developer
1 month ago
Bhubaneshwar, Odisha, India Cognizant Full timeLead Role: Lead AWS Serverless Architect Responsibilities Design and oversee the deployment of serverless architectures using AWS technologies. Lead the troubleshooting and debugging of complex data pipelines and service disruptions. Mentor junior team members and manage a team involved in tier two support. Skills Required Expertise in AWS serverless...
