Amazon Glue
2 weeks ago
**AMAZON GLUE**
**-**
**(**
**0102530**
**)**
**Description**
- 7-15 years of experience as a data engineer in datawarehouse/big data setting
- Developing algorithms for converting basic data into high level metrics
- Developing Python functions to pass data to database and Develop procedures, packages and scripts for data migration.
- Writing SQL code to process raw data
- Good experience of Python ORMs, Flask, NumPy, MatPlotlib, Scikit learn, Pandas, sqlalchemy, Alembic, Django. Google Products API Integration is a plus
- SQL Programming -Stored Procs, Functions, Triggers, Algorithms
- Good hands on skills in MySQL, PostgreSQL, Redis, RabbitMQ, MongoDB, Kafka
- Airflow - development, scheduling and configuration
- Good knowledge of DevOps tools like Docker, Docker Compose, GitHub, BitBucket
- Experience in BI Development and Deployment, ER model and Multidimensional model
- Familiar/Good knowledge with AWS functions related to ETL (AWS Batch, AWS Glue, Lambda)
- R&D and testing APIs to identify useful data items
- Processing large amounts of structured and unstructured data GOOD TO HAVE
- Agile/Scrum, Communication (Spoken English, clarity of thought) GOOD TO HAVE
**Primary Location***: India
**Job Posting***: Jul 13, 2023
**Experience Required (In Years)***:
**Minimum**
- 7
**Maximum**
- 15
-
Data Engineer
Found in: Whatjobs IN C2 - 3 weeks ago
india Unison Consulting Pte Ltd Full timeBachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field. At least 8+ years of strong data warehousing experience using RDBMS and Non-RDBMS databases. At least 5 years of recent hands-on professional experience (actively coding) working as a data engineer (back-end software engineer...
-
Data Engineer
Found in: Appcast Linkedin IN C2 - 4 days ago
India RiskInsight Consulting Pvt Ltd. Full timeAt least 8+ years of strong data warehousing experience using RDBMS and Non-RDBMS databasesAt least 5 years of recent hands-on professional experience (actively coding) working as a data engineer (back-end software engineer considered)Professional experience working in an agile, dynamic and customer facing environment is requiredUnderstanding of distributed...
-
Data Engineer
Found in: Whatjobs IN C2 - 2 weeks ago
india RiskInsight Consulting Pvt Ltd Full timeAt least 8+ years of strong data warehousing experience using RDBMS and Non-RDBMS databases. At least 5 years of recent hands-on professional experience (actively coding) working as a data engineer (back-end software engineer considered). Professional experience working in an agile, dynamic and customer facing environment is required. Understanding of...
-
AWS Data Engineer
2 weeks ago
India Changeleaders.in Full timeJob Description AWS Data Engineer About RoleExperience – 5 to 11yearsLocation- Bangalore (Hybrid)Notice- 0 to 15 days.Pyspark – should be strong.Detailed JD –Job Title: Data SpecialistDescription –Primary Skill Required Athena, SNS, SQS, CloudWatch, Spark - Scala, CloudFormation, EMR, DynamoDB, Amazon API Gateway, SCT, Redshift, DMS Glue,...
-
Senior Software Engineer
Found in: Whatjobs IN C2 - 3 weeks ago
india Accion Labs Full timeWe are a team of Engineers, Designers, Thinkers, Product Managers, Problem solvers and more. We are bound by our commitment to help teams succeed with our culture of learning & innovation. We seek solutions for tomorrow and build them today. We believe in ‘Driving Outcomes Through Actions’. Treating our employees, the same way we treat our customers is...
-
Senior Data Architect
Found in: Appcast Linkedin IN C2 - 2 weeks ago
India DigiHelic Solutions Pvt. Ltd. Full timeExperience- 9-12 yrsLocation- Chennai-HybridJD-Job SummaryWe are seeking a highly skilled and motivated Product Solution Architect with extensive expertise in designing and implementing cutting-edge big-data solutions on the Amazon Web Services (AWS) platform.As a key member of our dynamic team, you will play a pivotal role in driving the success of our...
-
Senior Data Architect
Found in: Whatjobs IN C2 - 2 weeks ago
India DigiHelic Solutions Pvt. Ltd. Full timeExperience- 9-12 yrs Location- Chennai-Hybrid JD- Job Summary We are seeking a highly skilled and motivated Product Solution Architect with extensive expertise in designing and implementing cutting-edge big-data solutions on the Amazon Web Services (AWS) platform. As a key member of our dynamic team, you will play a pivotal role in driving the success of our...
-
Business Intelligence Engineer
Found in: Appcast Linkedin IN C2 - 12 hours ago
India ZIDEA Full timeResponsibilities: Design, develop, and maintain BI solutions on AWS, including data pipelines, data warehouses, and reporting dashboards.Collaborate with business stakeholders to understand BI requirements and translate them into technical solutions.Design and implement scalable data models optimized for reporting and analytics needs. Create and optimize...
-
Data Engineer
Found in: Whatjobs IN C2 - 3 days ago
india Sun Life Full timeKey Responsibilities This is a position for AWS data engineer typically works on development, implementing, and maintaining data solutions on the Amazon Web Services (AWS) platform. Working with the Subject Matter Experts and Business Analysts to grasp the best knowledge of existing/ new SLF investment product architecture and implement new features in the...
-
Sr. Data Engineer
Found in: Whatjobs IN C2 - 1 day ago
india MDMS Recruiting LLC Full timeJob Description ***W2 or Self Inc. Only | this is not open to subcontracting (no C2C)*** Senior Data Engineer to help the design/build of the enterprise data platforms Design, Develop and ImplementEnd-to-end data solutions (ingest, storage, integration, processing, access) on AWS.Data intake/ request/ onboarding services and service documentation.Data...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Ridgeant Techonologies Full timeResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as- Glue, S3, Lambda, DynamoDB, Athena, and RedShift.- Implement data...
-
Data Engineer
Found in: Whatjobs IN C2 - 3 weeks ago
Anywhere in India,Multiple Locations Ridgeant Techonologies Full timeResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as- Glue, S3, Lambda, DynamoDB, Athena, and RedShift.- Implement data...
-
Big Data Specialist
2 weeks ago
India Cotocus Com Full timeJob Description BE/MCA with 8 + years of total experience of which minimum of 6 + years of experience in Design / Implementation of Big Data applications / Analytical SystemsMin 5 + years of strong in depth experience in Hadoop/Spark Core based implementations including Lambda architectureStreaming / Batch processing / Kafka / Hive / Impala / Hbase / MongoDB...
-
Data Engineering
Found in: Whatjobs IN C2 - 1 week ago
india Fractal Full timeWe are seeking a talented Lead Data Engineering Manager to support a Fortune 500 Technology Client. The ideal candidate will have 7-12 years of experience in setting up & implementing digital analytics (Adobe Analytics). leading data modeling and ETL development, APIs that serve real-time data, and aggregated dashboards, growing and mentoring junior...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Anywhere in India/Multiple Locations, IN Teksands.ai Full timeThe Data engineer is responsible for development & maintenance of the Data Lake within the Advice & Wealth Management technology team. You should be able to collaborate with technology cross-commits and business teams to code, test and deploy scalable solution and adhering to required quality standards. You must be a self-starter, think outside the box and...
-
Data Engineer
Found in: Whatjobs IN C2 - 1 week ago
Anywhere in India,Multiple Locations Teksands.ai Full timeThe Data engineer is responsible for development & maintenance of the Data Lake within the Advice & Wealth Management technology team. You should be able to collaborate with technology cross-commits and business teams to code, test and deploy scalable solution and adhering to required quality standards. You must be a self-starter, think outside the box and...
-
Data Engineer
Found in: Whatjobs IN C2 - 2 days ago
Anywhere in India/Multiple Locations Teksands.ai Full timeThe Data engineer is responsible for development & maintenance of the Data Lake within the Advice & Wealth Management technology team. You should be able to collaborate with technology cross-commits and business teams to code, test and deploy scalable solution and adhering to required quality standards. You must be a self-starter, think outside the box and...
-
Freelance AWS Data Engineer
Found in: Whatjobs IN C2 - 6 days ago
india ThreatXIntel Full timeCompany Description ThreatXIntel is a startup cyber security company specializing in protecting businesses and organizations from cyber threats. Our services include cloud security, web and mobile security testing, cloud security assessment, and DevSecOps. We believe that every business, regardless of size, should have access to high-quality and affordable...
-
Freelance AWS Data Engineer
Found in: Appcast Linkedin IN C2 - 6 days ago
India ThreatXIntel Full timeCompany DescriptionThreatXIntel is a startup cyber security company specializing in protecting businesses and organizations from cyber threats. Our services include cloud security, web and mobile security testing, cloud security assessment, and DevSecOps. We believe that every business, regardless of size, should have access to high-quality and affordable...
-
Data Engineer
Found in: Adzuna IN C2 - 2 weeks ago
Pune/Hyderabad/Anywhere in India/Multiple Locations, IN Huquo Full timeBasic understanding of :- Scheduling and workflow management & working experience in either ADF, Informatica, Airflow, or Similar- Enterprise Data Modelling and Semantic Modelling & working experience in ERwin, ER/Studio, PowerDesigner, or Similar- Logical/Physical model on Big Data sets or modern data warehouse & working experience in ERwin, ER/Studio,...