Data Pipeline Specialist
6 days ago
ANSR is hiring for one of its client.About Visy:Visy is a family-owned Australian business and a global pioneer in sustainable packaging, recycling and logistics. They operate across 150 sites globally, including operations in Asia, Europe, and the USA, supported by a dedicated workforce of over 7,000 employees. It is Australia and New Zealand’s largest manufacturer of food and beverage packaging, made from household recycling. As Australia’s largest recycler, it processes 40% of Australian households recycling. Visy also supports customers with logistics, packaging supplies, point of sale displays and more. At Visy India, their technology hub in Hyderabad, they are expanding their technical capabilities to support their global business.Primary Responsibilities: Data Pipeline Development: Design and implement scalable data pipelines using AWS services such as Glue, Lambda, and Kinesis.Redshift Management: Optimize and maintain Redshift clusters, including query tuning and performance optimization.Data Integration: Automate the ingestion, transformation, and integration of diverse data sources into data lakes and warehouses.Data Modelling: Develop efficient data models and schemas for analytical and operational use cases.Collaboration: Work closely with data analysts, scientists, and stakeholders to understand requirements and deliver reliable solutions.Data Governance: Ensure data quality, security, and compliance using AWS tools like IAM and Lake Formation.Documentation: Create and maintain comprehensive documentation for workflows, pipelines, and infrastructure. Experience & Qualifications:Mandatory (critical for the Role):Bachelor’s degree in Computer Science, Engineering, or a related field.3 to 5 years of experience in data engineering or related roles.Proficiency in AWS services, including Redshift, Glue, S3, Lambda, and Athena.Advanced SQL skills with experience in query optimization.Strong understanding of ETL/ELT processes, data modelling, and data warehousing.Familiarity with CI/CD pipelines and Infrastructure as Code (e.G., CloudFormation, Terraform).Excellent problem-solving skills and ability to manage multiple tasks.Skills (Technical, Business, Leadership):AWS Services: Amazon Redshift, S3, Lambda, Glue, RDS, Athena, KinesisDatabases: Amazon Redshift, PostgreSQL, MySQLLanguages: SQL, Python, RETL Tools: AWS Glue, Apache Spark, SAP Data ServicesData Modelling: Star/Snowflake Schema, Data WarehousingVersion Control: Git, GitHub, BitbucketCI/CD Tools: AWS CodePipelineMonitoring/Logging: CloudWatch, AWS X-RayBig Data: Experience with large datasets and distributed computingAWS certification (e.G., AWS Certified Data Engineer – Specialty).Experience with Python or other programming languages for data processing.Knowledge of big data frameworks and machine learning workflows.Knowledge SAP MM, SAP Sales and SAP Finance is desirableSolid understanding of leading and contemporary practices and capabilities in information management, data governance, reporting and analyticsExperience in production support/BAUWorking knowledge of change control processes and impactsA high degree of problem solving and technical skill is mandatory.Should be able to evaluate and prioritize tasksInvolvement in a mixture of new application development, maintenance and technical support.Ability to effectively liaise with internal customers at all levels within the organization, and, in some cases, may be required to deal with external parties including development organization and specialist consultants.
-
Senior Data Pipeline Specialist
2 weeks ago
hyderabad, India beBeeData Full timeJob Title: Senior Data Pipeline SpecialistCompany Overview: We're seeking a seasoned expert in data engineering to join our team.Job Description: As a Senior Data Pipeline Specialist, you'll design, build, and maintain large-scale data pipelines using tools like Cloud Composer, Dataflow, BigQuery, and Cloud Storage. Your primary focus will be on developing...
-
hyderabad, India beBeeDataPipelining Full timeJob Title: Quality Assurance Specialist - Data PipeliningJob DescriptionWe are seeking a skilled professional to fill the role of Quality Assurance Specialist - Data Pipelining.Required Skills and QualificationsETL/Data Pipeline Testing: Perform end-to-end testing of ETL pipelines across cloud/on-prem environments, including validation of source-to-target...
-
Data Pipeline Specialist
2 weeks ago
hyderabad, India beBeeDataEngineer Full timeJob OverviewAs a Data Engineer, you will be responsible for designing and developing robust data pipelines and platforms that enable efficient storage, processing, and consumption of data across the enterprise.The role requires high-quality, timely, and governed data delivery to data scientists, analysts, and business users. You will play a crucial role in...
-
Data Pipeline Specialist
2 weeks ago
hyderabad, India beBeeCloud Full timeJob Description: We are seeking a highly skilled and experienced Unix & Cloud Data Support Engineer to join our team. This is a challenging role that requires strong technical skills, excellent communication skills, and the ability to work in a fast-paced environment.As a Unix & Cloud Data Support Engineer, you will play a crucial role in ensuring the...
-
Data Pipeline Specialist
5 days ago
hyderabad, India beBeeBackend Full timeObservability Engineer OpportunityKey Responsibilities:Design and implement scalable data pipelines using cloud platforms.Collaborate with cross-functional teams to develop high-quality APIs, data models, and data pipelines.Develop backend services in multiple programming languages ensuring efficient performance.Requirements:5+ years of experience in...
-
Data Engineer
5 days ago
hyderabad, India beBeeDataEngineer Full timeRole OverviewThis role offers an exciting opportunity to utilize your expertise in data processing and pipeline design to drive business growth and success. You will be responsible for developing, configuring, and optimizing Salesforce Data Processing Engine (DPE) workflows and pipelines to meet the evolving needs of our organization.The ideal candidate will...
-
Azure Data Pipeline Specialist
6 days ago
Hyderabad, India Wall Street Consulting Services LLC Full timeJob Summary: We are seeking a highly skilled Senior Azure Data Engineer to design, develop, and optimize data pipelines and solutions within the Microsoft Azure ecosystem. The ideal candidate will have strong experience with Azure Data Factory (ADF), SQL, JSON data processing, and Python-based ETL pipelines, along with an understanding of Property & Casualty...
-
Snowflake Data Pipeline Specialist
4 days ago
hyderabad, India beBeeDataEngineer Full timeAbout the RoleWe are seeking a skilled Data Engineer to join our team in designing, developing and optimizing data pipelines using Snowflake and DBT.Key Responsibilities:Design, develop and optimize ETL processes with a focus on Snowflake integration.Collaborate with stakeholders to gather and analyze requirements.Architect and implement efficient data...
-
Data Analyst
4 weeks ago
Hyderabad, India Pipeline Medical Full timeOVERVIEW The Data Analyst role involves managing and analyzing large datasets using SQL, Excel, and Zoho Analytics to create insightful reports and dashboards for various stakeholders. The position requires developing predictive models and collaborating with cross-functional teams to optimize processes and improve organizational performance. Strong...
-
Data Analyst
4 weeks ago
Hyderabad, India Pipeline Medical Full timeJob Description OVERVIEW The Data Analyst role involves managing and analyzing large datasets using SQL, Excel, and Zoho Analytics to create insightful reports and dashboards for various stakeholders. The position requires developing predictive models and collaborating with cross-functional teams to optimize processes and improve organizational performance....
