In part 1 of this blog post, we discussed the need to be mindful of data bias and the resulting consequences when certain parameters are skewed. Surely there are ways to comb through the data to minimise the risks from spiralling out of control. We need to get to the root of the problem. In 2019, the Gradient institute published a white paper outlining the practical challenges for Ethical AI.
There is an explosion of data from a myriad of sources and an insatiable demand to consume it. Traditional manual ETL methods are too brittle to keep up. Leaving many a BI team struggling to provide meaningful business insights quickly.
Financial products are no longer characterized by the steps of filling out a form, waiting for a credit decision and, if successful, watching the monthly payments leaving your account.
For Cloudera ensuring data security is critical because we have large customers in highly regulated industries like financial services and healthcare, where security is paramount. Also, for other industries like retail, telecom or public sector that deal with large amounts of customer data and operate multi-tenant environments, sometimes with end users who are outside of their company, securing all the data may be a very time intensive process.