Scaling to Build the Consolidated Audit Trail: A Financial Services Application of Google Cloud Bigtable 9
Acknowledgements
We would like to thank the following people for providing their
help,
support, and technical and domain expertise in getting this proof of
concept built: Sal Sferrazza, Sam Sinha, Benjamin Tortorelli, Meghadri
Ghosh, Srikanth Narayana, Keith Gould, Peter Giesin, Chris Tancsa,
Patricia Motta, Adriana Villasenor, Petra Kass, Gemma Wipfler, Steven
Silberstein, and Marianne Brown at FIS, and especially the Google Cloud
Bigtable team, who have been awesome.
More Information
FIS (formerly SunGard) Tests CAT Prototype Using Google Cloud Bigtable, with
Quarter Hour Ingestion Rates Equivalent to 10 Billion Financial Trade
Records per Hour: http://bit.ly/1JOn4do
SunGard Homepage: http://www.sungard.com
Announcing Google Cloud Bigtable: Google’s world-famous database is now
available for everyone: http://goo.gl/lVWXuy
References
[1] Google. “Announcing Google Cloud Bigtable: Google’s world-famous database
is now available for everyone,” googlecloudplatform.blogspot.com.
[Online]. Available: http://goo.gl/lVWXuy [Accessed May 4, 2015].
[2] Google. “Google Cloud Platform,” cloud.google.com. [Online].
Available: https://cloud.google.com/ [Accessed: May 4, 2015].
[3] CAT NMS Plan Participants, National Market System Plan Governing
the Consolidated Audit Trail Pursuant to Rule 613 of Regulation NMS
under the Securities Exchange Act of 1934. catnmsplan.com [Online].
Available: http://catnmsplan.com/web/groups/catnms/@catnms/
documents/appsupportdocs/p602500.pdf [Accessed: May 4, 2015].
[4] F. Chang, J. Dean, S. Ghemawat, W. Hsieh, D. Wallach, M. Burrows,
T. Chandra, A. Fikes and R. Gruber, “Bigtable: A Distributed Storage
System for Structured Data,” in Proceedings of the 7th USENIX
Symposium on Operating Systems Design and Implementation, May 30-Jun.
3, 2006, Boston, MA, Berkeley, CA: USENIX Association, 2006.
[5] CAT NMS Plan Participants, “SROs Select Short List Bids for the
Consolidated Audit Trail”, catnmsplan.com [Online]. Available: http://
catnmsplan.com/web/groups/catnms/@catnms/documents/
appsupportdocs/p542077.pdf [Accessed: May 4, 2015].
[6] A. Tabb and S. Bali, “The Consolidated Audit Trail (Part I):
Reconstructing Humpty Dumpty,” Tabb Group, Westborough,
MA, Mar. 2 2015.
[7] A. Tabb and S. Bali, “The Consolidated Audit Trail (Part II):
Problems and Pitfalls,” Tabb Group, Westborough, MA,
Mar. 10 2015.
[8] United States of America. Securities and Exchange Commission,
Consolidated Audit Trail. 17 CFR § 242 (2012).
[9] Financial Information Exchange Protocol Version 4.2, Fix Protocol
Limited, 2001.
[10] Google. “Cloud Storage” cloud.google.com. [Online]. Available:
https://cloud.google.com/storage/ [Accessed: May 4, 2015].
[11] S. Gallagher (2012, Jan 26). “The Great Disk Drive in the Sky: How
Web giants store big—and we mean big—data”. Ars Technica [Online].
Available: http://arstechnica.com/business/2012/01/26/the-big-
disk-drive-in-the-sky-how-the-giants-of-the-web-store-big-data/
[Accessed: May 4, 2015].
[12] Financial Information Forum, FIF Consolidated Audit Trail (CAT)
Working Group Response to Proposed RFP Concepts Document, Financial
Information Forum, Jan. 18 2013. [Online]. Available: http://
catnmsplan.com/web/groups/catnms/@catnms/documents/
appsupportdocs/p602500.pdf [Accessed: May 4, 2015].
[13] C. Metz (2012, Jul. 10). “Google Remakes Online Empire with
‘Colossus’”, Wired [Online]. Available: http://www.wired.
com/2012/07/google-colossus/ [Accessed: May 4, 2014].
[14] Google. “Command-Line Deployment,” cloud.google.com [Online].
Available: https://cloud.google.com/hadoop/setting-up-a-hadoop-
cluster [Accessed: May 4, 2015].
[15] Google. “Google Compute Engine,” cloud.google.com. [Online]. Available:
https://cloud.google.com/compute/ [Accessed May 4, 2015].
[16] Google. “Instances,” cloud.google.com. [Online]. Available: https://
cloud.google.com/compute/docs/instances [Accessed: May 4, 2015].
[17] R. Vijayakumari, R. Kirankumar and K. Gangadhara Rao,
“Comparative analysis of Google File System and Hadoop
Distributed File System”, International Journal of Advanced Trends
in Computer Science and Engineering, vol. 3, no. 1, pp. 553-558, Feb.
2014. [Online]. Available: http://www.warse.org/pdfs/2014/
icetetssp106.pdf [Accessed: May 4, 2015].
[18] S. Kaisler, Software Paradigms. Hoboken, N.J.: Wiley-Interscience,
2005.
[19] N. Gunther, Guerrilla Capacity Planning. Berlin: Springer, 2007.
[20] C. Chambers, A. Raniwala, F. Perry, S. Adams, R. Henry, R.
Bradshaw and N. Weizenbaum, “FlumeJava,” in Proceedings of the
2010 ACM SIGPLAN conference on Programming language design and
implementation, June 5-10, 2010, Toronto, ON, New York: ACM, 2010.
pp. 363-375.