Data & Analytics skills in 2024, where to focus?
- Deren Ridley
- Jan 28, 2024
- 5 min read
Updated: Jan 29, 2024
As someone who interacts with professionals in the Data & Analytics market on a daily basis, I am often asked by candidates where they should be upskilling or where I see the biggest increases in demand in the market. So far in 2024, the two key areas I am seeing a large increase in demand are in Data Governance/Enablement and DataOps requirements. In this article you will find my thoughts on both of these areas as well as insights from Ayoob Ibrahim - Talent Acquisition Manager at Billigence who works closely with projects in the Data Enablement space.
Data enablement and governance may see similar on the surface, but they are quite different in practice.
Data Governance is the process of managing the availability, usability, integrity, and security of the data used in an organization. It involves the creation of policies, procedures, and standards to ensure that data is managed effectively and efficiently. Data Governance is essential for organizations that rely on data to make informed decisions. It helps ensure that data is accurate, reliable, and consistent across the organization. Data Governance also helps organizations comply with regulatory requirements and avoid costly penalties.
Data enablement is the practice of ensuring that the right data is accessible to the right people, has become a critical aspect of organizational success. In the past, data governance may not have been a popular topic, but with the increasing emphasis on compliance, especially with regulations like GDPR, it has become crucial. Now, the focus is on discussing the benefits and long-term returns associated with proper data handling. Ensuring that the right data is accessible to the right people can significantly expedite high-level decision-making, ultimately driving revenue. The shift towards data enablement reflects a positive approach, highlighting the strategic advantages and opportunities that effective data utilization can bring to an organization.
Ayoob says: "The surge in demand for effective data governance, or as we prefer to call it, data enablement, has sparked a noticeable shift in the industry. Small to mid-sized consultancies, exemplified by companies like Billigence, are increasingly taking on more work in this domain. This trend is challenging the dominance of the traditional big players, often referred to as the "Big 4."
One key factor contributing to this shift is the specialized expertise that smaller consultancies bring to the table. Unlike the Big 4, which may have a more generalized approach, smaller firms often focus on specific industries or sectors, allowing them to develop a deep understanding of the unique challenges and nuances within those domains.
Enter the role of a Data Enablement Analyst or Manager, a crucial position tasked with overseeing and ensuring the effective and secure management of an organization's data assets. These professionals play a pivotal role in implementing policies, standards, and processes to safeguard data integrity, privacy, and compliance.
When it comes to the skills required for success in this field, expertise in Data Quality, Data Management, and a thorough understanding of General Data Protection Regulation (GDPR) are paramount. Small to mid-sized consultancies excel in recruiting individuals with precisely these skill sets, as they prioritize hiring experts who can navigate the intricacies of data enablement within specific industries.
A quick look at the most common industries hiring Data Enablement professionals reveals a diverse landscape. Technology, Information and Internet, Credit Intermediation, and Insurance are among the sectors leading the charge in adopting robust data enablement practices.
Interestingly, the gender distribution in data enablement hires is evolving. As of 2023, the industry sees a notable balance, with women representing 40% of hires and men constituting the remaining 60%. This shift towards gender diversity highlights the industry's commitment to fostering an inclusive workforce.
As remote and hybrid work models continue to gain traction across various industries, the availability of remote jobs in data enablement stands at 6.0%, while hybrid job opportunities are significantly higher at 72.2%. This flexibility in work arrangements aligns with the changing dynamics of the modern workplace and allows professionals in the field to adapt to the evolving nature of data enablement.
The realm of data enablement signals a paradigm shift in how organizations approach the management of their data assets. With a focus on specialized domain knowledge, these consultancies are proving that expertise often trumps size, offering tailored solutions that resonate with the unique challenges faced by businesses in today's data-driven world. The shift from data governance to data enablement reflects a positive evolution, highlighting strategic advantages and opportunities for organizations to thrive in the era of data-driven decision-making."
In addition to the concepts of Data Governance and Enablement, there are several technologies that can help organizations manage their data more effectively.
Collibra is a popular platform for Data Governance & Enablement that provides flexible governance, continuous quality, and built-in privacy to all types of data. It allows organizations to automate and operationalize data governance workflows and processes, and deliver trusted data for the people, by the people across the organization.
DataOps is a set of practices, processes, and technologies that enable organizations to improve the speed, accuracy, and reliability of their data
management and analytics operations. DataOps is often compared to DevOps and agile methodologies used in software development, as it aims to break down silos, encourage collaboration, and streamline workflows for data teams. The core philosophy of DataOps is to treat data as a valuable asset that must be managed and processed efficiently. It emphasizes the importance of collaboration between different teams, such as data engineers, data scientists, and business analysts, to ensure that everyone has access to the right data at the right time. DataOps also encourages a culture of continuous improvement and innovation, as teams work together to identify and address bottlenecks and inefficiencies in their data pipelines and processes.
DataOps often involves managing cloud infrastructure and orchestration tools to quickly deliver high-quality data with improved security. Some of the cloud infrastructure responsibilities that DataOps roles often include are:
Designing and implementing the technical infrastructure for data pipelines
Managing and deploying data infrastructure
Setting up standards, processes, and methodologies for data analytics products
Providing access to multiple data sources
Facilitating testing and monitoring of data management processes
Governing data quality, security, privacy, retention
Generating data model and data versioning
Ensuring compliance with company security standards
Some of the technologies that can help with these responsibilities include Azure BICEP and Terraform. Both of these tools are infrastructure-as-code (IaC) tools that allow you to manage your cloud infrastructure as code. While Terraform is a general-purpose tool, BICEP is designed specifically for Azure-related tasks. They both offer CLI tools and allow you to manage IT and development infrastructure as code .
The average contract day rates for Data Governance/Enablement and DataOps consultants are between £500 and £600 per day . These rates are indicative of the high demand for these skills in the market. Organizations are willing to pay a premium for professionals who can help them manage their data effectively and efficiently.
Of course there are other more known areas of the Data & Analytics world that also have a high demand but If you are looking to upskill in the Data & Analytics market in 2024, these are two areas certainly worth considering.
Comments