AWS Data Lakehouse Consultant

3 weeks ago


india Tri-Force Consulting Services, Inc. Full time
Job Description
Title : Amazon Web Services(AWS) Architect
Location : Waterbury Village Historic District, VT 05676
Client : The Vermont Department of Public Safety
Note : This is an onsite position day 1 onsite
Job Description :

  • The Vermont Department of Public Safety (DPS) is seeking to improve statewide law enforcement data access.
  • The purpose is to design and implement a state-controlled system to access de-identified, aggregated law enforcement and
    related data currently housed in a record management system.
  • DPS, in collaboration with the Vermont Agency of Digital (ADS) Services, is seeking to procure Amazon Web Service (AWS) professional services to work with the ADS Technical Lead to build out the Public Services Lake house environment.
Design and implement the Department of Public Safety Data Lake in the AWS
Environment
  • Store Data in AWS CJIS compliant environment.
  • Implement and design the lake house technologies with the IT Tech Lead assigned to the project.
  • Design and implement using latest AWS Lake House standards.
  • Data Security Layer
  • Implement and design security Identity and Access Management roles and processes.
  • Design and Create security IAM templates.
  • Data Ingestion Layer
  • Ingestion Design for variety of sources
  • Operational Database Sources
  • MySQL, SQL Server
  • SaaS Applications
  • File Shares (SharePoint and one drive)
  • Stream Data Sources
  • System Templates of ingestion processes
    Data Storage Layer
  • AWS S3 CJIS compliant S3 buckets
  • AWS Redshift Infrastructure
  • Power BI Connector process
    Data Processing Layer
  • Data Extract, Load and Transform (ELT) process for loading from source to S3 and Transforming data from S3 to Redshift for reporting and analytics.
  • Templates for creating ELT processes for future processes.
Data Catalog Layer
  • Design and implement solution to solve data schema drift in AWS Glue for use with reporting and analytical needs.
  • Design and build crawlers for schema and build catalog that stores schema information.
  • Meta data store in catalog for consumption in data warehouse
  • Create Catalog crawler templates for data sources
PROFESSIONAL SERVICE REQUIREMENTS
  • AWS Lake house Certification
  • AWS Design and Implementation Lake House Technologies
  • AWS IAM
  • AWS Lake house Technology
  • AWS Glue Knowledge
  • Data Catalog and Crawler
  • AWS Redshift
  • AWS Athena
  • CJIS certified data storage
  • AWS CJIS Data location
  • CJIS Security Background Check (See Additional Attachments / Assurances)

If you are: bright, motivated, skilled, a difference-maker, able to get things done, work with minimum direction, enthusiastic, a thinker, able to juggle and multi-task, communicate effectively, and lead, then we would like to hear from you. We need exceptionally capable people for this role for our client, so get back to us and tell us why you think you are a fit.
About Us:
Tri-Force is one of the fastest growing companies in the Philadelphia region by receiving the award 5 times and 3 times (Ranked #931 2021) on In c. 5000 fastest growing companies in the USA. Tri-Force Consulting Services, In c. is an established consulting services firm offering innovative solutions to Government and Commercial sectors.
We specialize in building customized software applications solutions such as knowledge management systems, business intelligence, data analysis, database support and maintenance, data warehouse implementation and support, systems architecture and systems integration for our clients. Our technical competencies are in Java,.NET, SharePoint, PHP, Business Intelligence (Cosign, Data Warehouse), mobile applications platforms (iPhone, iPad, Android, Blackberry), and various other technologies. We also specialize in providing resources to manage infrastructure projects. 
Tri-Force is one of the fastest growing companies in the Philadelphia region by receiving the award 5 times and 2 times on In c. 5000 fastest growing companies in the USA.
Requirements
AWS Lakehouse Certification AWS Design and Implementation Lake House Technologies AWS IAM AWS Lakehouse Technology AWS Glue Knowledge Data Catalog and Crawler AWS Redshift AWS Athena CJIS certified data storage

  • india Tri-Force Consulting Services, Inc. Full time

    Job Description Title : AWS Data Lake house Consultant (Architect) Location: Waterbury Village Historic District, VT 05676Client: The Vermont Department of Public Safety Note: This is a hybrid position. Job Description: The Vermont Department of Public Safety (DPS) is seeking to improve statewide law enforcement data access.The purpose is to design and...

  • AWS Data engineer

    3 days ago


    india YASH Technologies Full time

    Experience 4 - 6 Years Job Description Masters / Bachelors Degree in Computer Science, Information Technology or other relevant fields. • Minimum 5+ Years of Mandatory experience in Advance Data & Analytics Architecture, ETL, Data Engineering solution using the following Skills, tools and technologies: • AWS Data & Analytics Services: Athena, Glue,...

  • Aptus Data Labs

    2 weeks ago


    india Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • AWS Data Engineer

    2 days ago


    india Deloitte Full time

    As an AWS Data Engineer Consultant at Deloitte, you will be a key player in designing, implementing, and optimizing data solutions on the Amazon Web Services (AWS) cloud platform. This role involves working closely with clients from various industries, understanding their data needs, and delivering robust data engineering solutions. Your role will involve:...

  • Aws Consultant

    1 week ago


    india Tech Mahindra Full time

    Dear Candidate , Hiring for AWS Consultant Exp-8 +Years work from office can join in 15 days JD: Must have: In-depth knowledge and hands-on experience with AWS services including EC2, S3, RDS, Lambda, VPC, IAM, CloudFormation, etc. Ability to design complex AWS solutions that meet business requirements and align with industry best practices. Proven...

  • AWS Data Engineer

    4 weeks ago


    Bangalore/Anywhere in India/Multiple Locations TalentPulse Consultant Full time

    Overview :- The AWS Data Engineer plays a crucial role in our organization by designing and implementing scalable, reliable, and secure data solutions in the AWS cloud environment.- They are responsible for developing and maintaining data pipelines, optimizing data workflows, and ensuring the quality and integrity of our data.- This position is essential for...

  • Senior AWS Developer

    3 weeks ago


    india TalentPulse Consultant Full time

    Job Description: Senior AWS Developer :We are seeking a highly skilled Senior AWS Developer with at least 7 years of experience in application development on the AWS platform. The ideal candidate should possess a deep understanding of orchestration components such as Lambda, Step Functions, EventBridge, and CloudWatch. Proficiency in GitHub and Continuous...

  • Aptus Data Labs

    2 weeks ago


    Anywhere in India/Multiple Locations Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Data Architect

    1 day ago


    india Marktine Technology Solutions Full time

    Job Description : We are looking for an experienced Data Architect with a strong background in data engineering and visualization to join our team. The ideal candidate will have hands-on experience in data warehousing, data lakes/lakehouses, and expertise in working with technologies such as Spark and Snowflake.Additionally, the candidate should have...

  • AWS Data Scientist

    2 weeks ago


    india ITTConnect Full time

    Job Description ITTConnect is seeking an AWS Data Scientist  to fill a permanent role with a client in the Atlanta area. This is a position with a client that is a global leader in consulting, digital transformation, technology and engineering services present in nearly 50 countries. The end client is in the telecommunications space (internet, cable TV,...

  • AWS Data Scientist

    7 days ago


    india ITTConnect Full time

    Job Description ITTConnect is seeking an AWS Data Scientist  to fill a permanent role with a client in the Atlanta area. This is a position with a client that is a global leader in consulting, digital transformation, technology and engineering services present in nearly 50 countries. The end client is in the telecommunications space (internet, cable TV,...


  • india Marlabs LLC Full time

    Description: What you’ll do • Spearhead the development of conceptual, logical, and physical data models, while • implementing data marts/data warehouse/data lake/data lakehouse on Spark-based • platforms • Analyse existing models to identify variances/gaps and devise strategies to achieve • alignment. • Establish and enforce best...


  • india TalentPulse Consultant Full time

    Role & Responsibilities :- Ensure Security in Snowflake Environment: Implement and maintain security best practices within the Snowflake environment, including access controls, encryption, and monitoring.- Develop Python Scripts for Data Processing: Create and maintain Python scripts to facilitate data processing tasks within the Snowflake environment,...

  • Senior Data Engineer

    14 hours ago


    india Bunker Full time

    Join Bunker, an early-stage FP&A SaaS startup poised to revolutionise the corporate finance function. Backed by leading investors like Alpha JWC, January Capital, GFC, and strategic angels including Patrick Walujo of Northstar Group, we leverage deep local insights and a contrarian approach to distinguish ourselves in the crowded fintech sector. With a...

  • Senior Data Engineer

    13 hours ago


    India Bunker Full time

    Join Bunker, an early-stage FP&A SaaS startup poised to revolutionise the corporate finance function. Backed by leading investors like Alpha JWC, January Capital, GFC, and strategic angels including Patrick Walujo of Northstar Group, we leverage deep local insights and a contrarian approach to distinguish ourselves in the crowded fintech sector. With a...


  • india Zone IT Solutions Full time

    We are looking for a highly skilled SAP BASIS Technical Consultant (AWS Migration). You will be responsible for supporting and overseeing the migration of SAP systems to the AWS cloud platform. Requirements Minimum 5 years of experience as an SAP BASIS Consultant, with specific expertise in AWS migration projects. Strong knowledge and hands-on experience...

  • AWS Data engineer

    1 month ago


    india Astrosoft Technologies Full time

    Title: AWS Database Migration Service (DMS) Specialist Responsibilities: Migration Planning: Assess existing database environments and develop migration strategies tailored to specific business requirements and constraints. Implementation: Configure and deploy AWS DMS resources to facilitate the migration of databases from on-premises or other cloud...

  • AWS Data Engineer

    2 weeks ago


    india Krishna Global Services Pvt. Ltd. Full time

    Job Title: AWS Data Engineer Location: Pune Experience Required: 6-9 Years Job Description: We are looking for a highly skilled AWS Data Engineer with a strong background in data and analytics to join our team in Pune. The ideal candidate will have extensive experience in designing, implementing, and managing data infrastructure on AWS. This role...

  • AWS Data Engineer

    2 weeks ago


    india Krishna Global Services Pvt. Ltd. Full time

    Job Title: AWS Data Engineer Location: Pune Experience Required: 6-9 Years Job Description: We are looking for a highly skilled AWS Data Engineer with a strong background in data and analytics to join our team in Pune. The ideal candidate will have extensive experience in designing, implementing, and managing data infrastructure on AWS. This role...

  • AWS Data Architect

    2 weeks ago


    india FIRST CAREER CENTRE Full time

    Job Description6-14 years experience in data management area in the implementation of modern data ecosystems in AWS/Cloud platforms. Strong experience with AWS ETL/File Movement tools ( GLUE, Athena, Lambda, Kenesis and other AWS integration stack) Strong experience with Agile Development, Cloud formation Template, AWS CodeBuilt, AWS Code Pipeline Strong...