Se Big Data
2 weeks ago
Responsibilities # Partner with business stakeholders to gather requirements and translate them into technical specifications and process documentation for IT counterparts (onshore and offshore) # Highly proficient in the architecture and development of an event driven data warehouse streaming, batch, data modeling, and storage # Advanced database knowledge creating optimizing SQL queries, stored procedures, functions, partitioning data, indexing, and reading execution plans # Skilled experien ce in writing and troubleshooting Python PySpark scripts to generate extracts, cleanse, conform and deliver data for consumption # Expert level of understanding and implementing ETL architecture data profiling, process flow, metric logging, and erro r handling # Support continuous improvement by investigating and presenting alternatives to processes and technologies to an architectural review board # Develop and ensure adherence to published system architectural decisions and development standar ds # Lead and foster junior data engineers in their careers to produce higher quality solutions at a faster velocity through optimization training and code review # Multi-task across several ongoing projects and daily duties of varying priorities as required # Interact with global technical teams to communicate business requirements and collaboratively build data solutions The duties listed above are the essential functions, or fundamental duties within the job classification. The essential fun ctions of individual positions within the classification may differ. May assign reasonably related additional duties to individual employees consistent with standard departmental policy. Qualifications # Bachelor#s degree in computer science or MIS r elated area required or equivalent experience (industry experience substitutable) # 10 years of experience in data development # 3 years of experience in Banking and financial domain # Expert level in data warehouse design architecture, dimensional data modeling and ETL process development # Advanced level development in SQL NoSQL scripting and complex stored procedures (Snowflake, SQL Server, DynamoDB, NEO4J a plus) # Extremely proficient in Python, PySpark, and Java # AWS Expertise # Kinesis.
Job Requirements: PySpark, Data Processing, ETL Pipeline
**Job Type**:
Full Time
**Location**:
KOLKATA
**Mandatory Skills**:
- PySpark
-
Big Data Developer
2 weeks ago
Kolkata, West Bengal, India newAmps Consulting Pvt. Ltd. Full time ₹ 8,00,000 - ₹ 12,00,000 per yearSalaryAs per the industry standardLocationKolkataJob InformationDescriptionA Big Data Developer needs to have a knowledge of core Java, SQL, and any scripting language along with good interpersonal skills. Big data developer is responsible for the actual coding or programming of Hadoop, Hive, Kafka & InfluxDB Applications.Skills required to become a Big data...
-
Soln Arch Big Data
2 weeks ago
Kolkata, India Mindtree Full time10 years of architecture experience - Strong expertise in using Erwin - Data modeling tool - Experience in Requirements engineering, Solution architecture, Design, Development and Deployment - A broad set of technical skills and knowledge across hardware, software systems and solution development across more than one technical domain. - Demonstrated...
-
Big Data Developer
1 week ago
Indore, Kolkata, Mumbai, India Alphacom Systems And Solutions Full time ₹ 6,00,000 - ₹ 10,00,000 per yearRole & responsibilitiesSkills : Big Data Scala SparkPreferred candidate profileLooking for 5to 12 YrsLocation: Mumbai, Indore & KolkattaInterview mode F-F Inperson 11Oct 25Notice Period : 0-30DaysInterested Candidates share your cv
-
Jr Tl Big Data
2 weeks ago
Kolkata, India Mindtree Full timeJOB SUMMARY A Technical Lead owns the deliverables of a sub-team to meet business objectives. A person in this role interfaces with several stakeholders including project and delivery teams as well as specialists and technical architect to ensure ali gnment of technical deliverables and architecture. They are responsible for ensuring quality, timeliness, and...
-
Senior Python Developer(Big Data)
2 days ago
Kolkata, West Bengal, India Xfusion Technologies Full time ₹ 10,00,000 - ₹ 25,00,000 per yearAbout the RoleWe are seeking a Senior Python Developer to lead the development of scalable, high-performance backend systems and data-driven applications. You will work on building robust services, APIs, and data workflows that power real-time and batch applications.This role is ideal for a seasoned developer who thrives on solving complex problems, building...
-
Sse Big Data
2 weeks ago
Kolkata, India Mindtree Full timeResponsibilities # Partner with business stakeholders to gather requirements and translate them into technical specifications and process documentation for IT counterparts (onshore and offshore) # Highly proficient in the architecture and development of an event driven data warehouse streaming, batch, data modeling, and storage # Advanced database knowledge...
-
Sse Big Data
2 weeks ago
Kolkata, India Mindtree Full timeBatch Engineer (Mandatory skill # AWS Glue ) - Expertise in batch and file-based integrations Experience of performing ETL ELT processes from multiple sources - Hands-on experience of working in AWS cloud environment and using Python, AWS Glue for data integrations - Experience of integrating with Snowflake eco-system and using of tools such as SnowSQL and...
-
Data Engineer
5 days ago
Kolkata, West Bengal, India Workmates Core2cloud Full time ₹ 4,00,000 - ₹ 12,00,000 per yearRole & responsibilitiesAbout the role:As a Junior/Senior Data Engineer, you'll be taking the lead in designing and maintaining complex data ecosystems. Your experience will be instrumental in optimizing data processes, ensuring data quality, and driving data-driven decision-making within the organization.Architecting and designing complex data systems and...
-
Excellent Opportunity for Gcp and Big Query
2 weeks ago
Kolkata, India Orcapod Full time**Roles and Responsibilities** Job Title : Data Engineer Job Summary: "Data Engineer: Around 7+ years of experience in development in Data warehousing projects in AWS & GCP platforms, 1) Good understanding of dimensional modeling 2) Expertise in MySQL & SQL/PL 3) GCP & BigQuery knowledge is must, GCP certification is added advantage 4) Good experience in...
-
[Apply Now] Data Visualization Engineer
1 week ago
Kolkata, India Soul Ai Full timeJob Description Responsibilities: - Architect and implement enterprise-level BI solutions to support strategic decision-making along with data democratization by enabling self-service analytics for non-technical users. - Lead data governance and data quality initiatives to ensure consistency and design data pipelines and automated reporting solutions using...