Senior Data Engineer

# Senior Data Engineer at N Consulting LtdWork mode: Hybrid Number of days a week worked in the office: 3 Contract duration: 3 Months Location: Bath --------------------------------------- JOB DETAILS Role Title: Senior Data Engineer The Senior Data Engineer must be an experience data professional with in-depth skills on AWS Cloud architecture, AWS data services, Data Pipeline automation (with AI integrations desirable) and ETL development (design, build, test and performance tune).

Must have knowledge on data modelling techniques, including dimensional models and conformed datasets. As the role is to engage both business and technical stakeholders, the individual must have clear and adequate communication with different stakeholders at the various levels of seniority.

Knowledge and Experience - essential - AWS Glue ETL - AWS Glue Data Quality - AWS Lambda - AWS Lake Formation - Medallion Architecture based ETL processes using S3, Iceberg and Athena - Azure DevOps/AWS CodeCommit/AWS CodePipeline - AWS Step functions - Athena SQL ; Spark SQL ; Python - AWS CLI - Release management (CI/CD) - Knowledge and Experience - desirable - AWS Databrew - AWS RDS/Redshift - AWS Macie - AWS CloudWatch - AWS Quick - AWS Sagemaker (Unified Studio and AI) - Power BI

Report this job