Publications

2021

Richard Cloete, Chris Norval, and Jatinder Singh. 2022. Auditable Augmented/Mixed/Virtual Reality: The Practicalities of Mobile System Transparency. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 4, Article 149 (Dec 2021), 24 pages. DOI:https://doi.org/10.1145/3495001

Rebecca Williams, Richard Cloete, Jennifer Cobbe, Caitlin Cotterill, Peter Edwards, Milan Markovic, Iman Naja, Frances Ryan, Jat Singh, Wei Pang. From Transparency to Accountability of Intelligent Systems. Data and Policy. 2021. https://ora.ox.ac.uk/objects/uuid:437a18bd-d550-4894-961f-c57bdaa813ac

Ari Ball-Burack, Michelle Seng Ah Lee, Jennifer Cobbe, and Jatinder Singh. 2021. Differential Tweetment: Mitigating Racial Dialect Bias in Harmful Tweet Detection. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’21). Association for Computing Machinery, New York, NY, USA, 116–128. DOI:https://doi.org/10.1145/3442188.3445875

Jennifer Cobbe, Michelle Seng Ah Lee, and Jatinder Singh. 2021. Reviewable Automated Decision-Making: A Framework for Accountable Algorithmic Systems. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’21). Association for Computing Machinery, New York, NY, USA, 598–609. DOI:https://doi.org/10.1145/3442188.3445921

Chiu Pang Fung, Wei Pang, Iman Naja, Milan Markovic, and Peter Edwards. Towards Accountability Driven Development for Machine Learning Systems. In Martin et al. (Eds.): SICSA Workshop on eXplainable Artificial Intelligence (XAI), June 2021, Online.

Seyyed Ahmad Javadi, Chris Norval, Richard Cloete, and Jatinder Singh. 2021. Monitoring AI Services for Misuse. Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society. Association for Computing Machinery, New York, NY, USA, 597–607. DOI:https://doi.org/10.1145/3461702.3462566

Michelle Seng Ah Lee and Jatinder Singh. 2021. Risk Identification Questionnaire for Detecting Unintended Bias in the Machine Learning Development Lifecycle. Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society. Association for Computing Machinery, New York, NY, USA, 704–714. DOI:https://doi.org/10.1145/3461702.3462572

Milan Markovic, Iman Naja, Peter Edwards, and Wei Pang. The Accountability Fabric: A Suite of Semantic Tools For Managing AI System Accountability and Audit. In Proceedings of the ISWC 2021 Demos and Industry Tracks. 2021. https://abdn.pure.elsevier.com/en/publications/the-accountability-fabric-a-suite-of-semantic-tools-for-managing-

Iman Naja, Milan Markovic, Pete Edwards, and Caitlin Cottrill. A Semantic Framework to Support AI System Accountability and Audit. In R. Verborgh et al. (Eds.): ESWC 2021, LNCS 12731, pp. 1–17, 2021. 10.1007/978-3-030-77385-4_10.

Chris Norval, Jennifer Cobbe, Jatinder Singh. (2021). Towards an accountable Internet of Things: a call for reviewability. Privacy by Design for the Internet of Things: Building accountability and security  (pp. 97-125). Institution of Engineering and Technology.

Chris Norval, Heleen Janssen, Jennifer Cobbe, Jatinder Singh. (2021) Data protection and tech startups: The need for attention, support, and scrutiny. Policy & Internet 13:2, pages 278-299 http://10.1002/poi3.255

Milan Markovic, Iman Naja, Peter Edwards, and Wei Pang. The Accountability Fabric: A Suite of Semantic Tools For Managing AI System Accountability and Audit. In Proceedings of the ISWC 2021 Demos and Industry Tracks. 2021. https://abdn.pure.elsevier.com/en/publications/the-accountability-fabric-a-suite-of-semantic-tools-for-managing-

Wei Pang, Milan Markovic, Iman Naja, Chiu Pang Fung, and Peter Edwards. On Evidence Capture for Accountable AI Systems. In Martin et al. (Eds.): SICSA Workshop on eXplainable Artificial Intelligence (XAI), June 2021, Online.

Jatinder Singh, Jennifer Cobbe, Do Le Quoc, and Zahra Tarkhani. “Enclaves in the Clouds.” Communications of the ACM 64, no. 5 (2021): 42-51.

2020

Jennifer Cobbe, Chris Norval, and Jatinder Singh. “What lies beneath: transparency in online service supply chains.” Journal of Cyber Policy 5, no. 1 (2020): 65-93.  Doi: 10.1080/23738871.2020.1745860

Jennifer Cobbe, Michelle Seng Ah Lee, Heleen Janssen, and Jatinder Singh. “Centering the Law in the Digital State.” Computer 53, no. 10 (2020): 47-58. doi: 10.1109/MC.2020.3006623

Jennifer Cobbe and Jatinder Singh. “Reviewable Automated Decision-Making.” Computer Law & Security Review 39 (2020): 105475. doi: 10.1016/j.clsr.2020.105475

Richard Cloete, Chris Norval, and Jatinder Singh. 2020. A Call for Auditable Virtual, Augmented and Mixed Reality. In 26th ACM Symposium on Virtual Reality Software and Technology (VRST ’20). Association for Computing Machinery, New York, NY, USA, Article 16, 1–6. DOI:https://doi.org/10.1145/3385956.3418960

Heleen Janssen, Jennifer Cobbe, Chris Norval, and Jatinder Singh. “Decentralized data processing: personal data stores and the GDPR.” International Data Privacy Law 10, no. 4 (2020): 356-384. doi: 10.1093/idpl/ipaa016

Seyyed Ahmad Javadi, Richard Cloete, Jennifer Cobbe, Michelle Seng Ah Lee, and Jatinder Singh. 2020. Monitoring Misuse for Accountable ‘Artificial Intelligence as a Service’. Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society. Association for Computing Machinery, New York, NY, USA, 300–306. DOI:https://doi.org/10.1145/3375627.3375873

Wagner B, Rozgonyi K, Sekwenz M, Cobbe J, Singh J. (2020). Regulating Transparency? Facebook, Twitter and the German Network Enforcement Act. ACM Conference on Fairness, Accountability, and Transparency 2020.

2019

Jennifer Cobbe and Jatinder Singh. Regulating Recommending: Motivations, Considerations, and Principles (April 15, 2019). (2019) European Journal of Law and Technology, 10(3), http://dx.doi.org/10.2139/ssrn.3371830

Do Le Quoc, Franz Gregor, Jatinder Singh, and Christof Fetzer. 2019. SGX-PySpark: Secure Distributed Data Analytics. In The World Wide Web Conference (WWW ’19). Association for Computing Machinery, New York, NY, USA, 3564–3563. DOI:https://doi.org/10.1145/3308558.3314129

Chris Norval and Jatinder Singh. 2019. Explaining automated environments: interrogating scripts, logs, and provenance using voice-assistants. In Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers (UbiComp/ISWC ’19 Adjunct). Association for Computing Machinery, New York, NY, USA, 332–335. DOI:https://doi.org/10.1145/3341162.3343802

Jatinder Singh, Jennifer Cobbe and Chris Norval, “Decision Provenance: Harnessing Data Flow for Accountable Systems,” in IEEE Access, vol. 7, pp. 6562-6574, 2019, doi: 10.1109/ACCESS.2018.2887201.

Conference contributions

25th September2021: Co-organised the Workshop on Reviewable and Auditable Pervasive Systems (WRAPS) as part of UbiComp 2021 collocated with the 2021 ACM International Symposium on Wearable Computers (ISWC’21): Chris Norval, Richard Cloete, Milan Markovic, Iman Naja, and Kristin B. Cornelius. “Workshop on Reviewable and Auditable Pervasive Systems (WRAPS).” In Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers, pp. 261-263. 2021. DOI: 10.1145/3460418.3479265

Demos

https://rains-uoa.github.io/ISWC_2021_Demo/

Other Reports

Coming soon

Engagement Activities

21 Sep 2021: Participated in Explorathon PechaKucha 2021.

15 Sep 2021: Held the event ‘Where’s the blame when the AI goes wrong?’ as part of Explorathon’21. 

17 June 2021: Attended the event AI Research Theme: SICSA AI All-Hands.

23 Nov 2020: Held the event ‘When the AI gets it wrong: Who’s to blame for technology’s failure?’ as part of Explorathon’20. 

26 Oct 2020: Held the event Breast Cancer Awareness: A discussion about AI in breast cancer screening in collaboration with the Industrial Centre for Artificial Intelligence Research in Digital Diagnostics (iCAIRD). 

09 June 2020: Attended Workshop on Accountability & Ethics in a Digital Ecosystem organised by SPRITE+.

25 Sep 2019: Held the event AI the Good, the Bad, and the Ugly as part of Explorathon’19. 

16 – 17 July 2019: Attended Workshop on AI Ethics in the Financial Sector organised by the Alan Turing Institute.

10 May 2019: Interviewed on Distributed Future podcast and talked about provenance and accountability for automated systems. Listen to the podcast here (episode 24). 

26 Feb 2019: Attended Workshop on Accountability and Emerging Technologies at the Alan Turing Institute at the British Library.