big data engineer jobs in County of Cardiff

We are looking for an experienced Big Data Engineer passionate about building and scaling high-throughput, real-time data processing systems. This critical role centers on leveraging distributed computing frameworks, such as the Spark or Hadoop ecosystems, to manage massive, rapidly growing datasets. Key duties involve designing streaming ingestion pipelines, ensuring low-latency data delivery,...

About The Role Job level: 10 The information below covers the role requirements, expected candidate experience, and accompanying qualifications. Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: - Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising and sharing...

You will be a key technical authority for Terraform across our Azure Data and AI platforms. What You’ll Be Doing In this role, you will: - Own and lead Terraform-based infrastructure design for Azure, ensuring scalability, security, and compliance by default. - Develop and maintain advanced Terraform modules, standards, and patterns used across multiple teams and environments.

Senior Data Engineer Job Title: Senior Data Engineer Salary Range: £80,000–£100,000 Location / Working model: London | Hybrid This is a critical technical position within a high-growth, forward-thinking organization that specializes in digital innovation. We require an experienced Senior Data Engineer to design, build, and maintain a robust, scalable, and high-performance system that is...

Senior Data Engineer | Remote (UK or Europe) A leading prop trading firm is hiring a Senior Data Engineer to take ownership of their trading and market data infrastructure. Operating globally with connectivity to dozens of exchanges, the firm executes millions of trades daily with data playing a mission-critical role in every aspect of the business. This is a high-impact, high-autonomy role in...

You will be involved in the entire data chain, from data ingestion to its use by data science teams and AI systems in production within a human-sized and multidisciplinary team. This role is within Process Intelligence (PI) team that combines functions such as Process Mining, Real Time Monitoring and Predictive AI

You will work closely with clients to understand their business challenges before designing tailored solutions that improve efficiency, drive self‑service reporting and support long‑term scalability.

You will also be able to supplement this hands-on experience with the opportunity to gain Microsoft focus certifications and accreditations.

Fabric Engineer - Fully Remote (UK) - Outside IR35 UK Security Clearance is essential. A leading consultancy is looking to engage an accomplished Senior Consultant for a high‑impact data and analytics programme. This role suits a seasoned specialist in data engineering, Microsoft Fabric, and solution delivery, with the ability to design, build and refine technical solutions that elevate...

Database Engineer (PostgreSQL & Python) - MUST BE BASED IN THE UK - Opportunity for a Database Engineer (Junior/Mid/Senior) to join a remote-first, UK-headquartered technology business - Competitive salary between £45,000 - £70,000 + excellent benefits including remote working, autonomy, and the chance to work on an Educational AI platform - Apply online or contact Chelsea Hackett via...

We are currently recruiting a Data Engineer for one of our clients. The role is outside IR35 and is paying £400-500 per day, it will initially be for 6 months. It is also fully remote. Key Responsibilities • Design, develop, and maintain batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data •...

Reports to: Technology Director / Executive Sponsor Location: Remote with occasional travel to London (2 times a month) Contract: Full-time, permanent Base Salary: £70,000 – £80,000 location and experience dependent + 10% company bonus scheme and sales commission scheme Why This Role Exists Serve Legal is entering a new chapter: evolving beyond compliance auditing into AI enabled,...

Start: ASAP Location: Cardiff (hybrid – some WFH once trained) A leading organisation is seeking an experienced Data Centre Operator to join their operations team on a long‑term contract. This role is ideal for someone who thrives in a fast‑paced environment, enjoys problem‑solving, and takes pride in keeping critical systems running smoothly. Please note: Control‑M experience is essential....

You will be responsible for driving revenue growth across a defined territory, developing relationships with end customers, consultants, integrators, and channel partners within the data centre ecosystem. The role blends strategic account development with hands-on opportunity management, selling integrated infrastructure solutions across power, cooling, cabinets, and monitoring.

You will work on real production problems rather than research-only work, owning models from first iteration through to live deployment.

You will collaborate closely with other data scientists, data engineers, and DevOps, with the freedom to shape how GenAI and ML are used across the platform.

You will bring significant experience of being an effective contributor in a cross‑functional team and communicating with external stakeholders.

You will collaborate closely with user researchers and product to identify opportunities for where AI can be used, using your extensive knowledge of AI.

Recruitment Consultant – Technology / Deep Tech Location: Remote-first (UK-based) Working Model: Fully remote with occasional team meet-ups Overview: A specialist recruitment consultancy is hiring experienced recruiters to support continued growth across technology and deep tech markets, partnering with high-growth startups and scale-ups. The business operates in an adult, high-trust...

Senior ML & AI Engineer Remote (Bath office 1 day per month) Up to £80,000 About the Role We’re partnered with a fast-growing tech startup focused on how brands and retailers use data. Their AI platform brings together data science, immersive visualisation, and large-scale machine learning to optimise product ranges, plan shopper journeys, and drive smarter commercial decisions. They’re now...

You will design, develop, and maintain our platform’s backend infrastructure, focusing on multi-tenant architectures, security, and efficient LLM integration. This role requires a strong understanding of Python web frameworks, cloud services (particularly AWS), and modern AI approaches including working with agentic architecture.

Technology Recruitment Consultant Working Pattern: Remote-first (UK) Sector Focus: AI, Quantitative, Engineering The Opportunity: An established technology recruitment business is growing its delivery capability and is looking to add experienced recruiters to the team. The firm works exclusively with venture-backed startups and scaling technology companies, supporting highly technical hiring...

You will work with a talented, experienced and supportive team and enjoy true flexibility with options to work completely remotely or in office as and when you wish. With a culture built on inclusion and continuous development, this is an environment where your expertise is valued, your ideas are heard and your career can grow.