this is a raw cut paste of an email from jed Below is an attempt to list all the steps that need to occur for Pass2 in an attempt to get a more systematic appro...
Analysis Environment Distributed Computing Requirements Support Multiple Distributed Computing Models Distributed systems such as ROOT/PROOF, some MPI and PVM im...
We are making a prototype for histogram visualization using OpenDX reading from XML files. The XML files are transliterated from ROOT format. The XML structure, u...
Design Ideas This page is a 'white board' for design ideas for the Analysis Environment Execution Engine The work is done by 'pulling' data from 'Leaf nodes' (i....
Data Presentation Example: Comparing Distributions Histograms are a standard way of looking at a data distribution. Often, one needs to compare data distributions...
#get all the external stuff from cmstools import * import ROOT #convert C iterators into a python generator def gen_from_iter(b,e): while( b = e ): yie...
Workflow Example: Higgs to ZZ with each Z going to two muons The workflow reads a file, gets the Events then finds the generator information, and if the generator...
Comparison Profiles for Different Implementations In all cases the same file of 100,000 Higgs to Z Z events were used. PyROOT directly import hotshot p= ...
Analysis Environment: Histogram Plotter Interface Wish List * The plotter shows the histogram as it is accumulating. While the plotter is updating it should ...
Analysis Environment Implementation Issues: Python Threads Python Threads Facts From the python documentation python does use native threads. However, python us...
The following is the original description I sent out to describe the system Principals Want users to concentrate on physics rather than debugging or book keepin...
1. Use cvs checkout from Chris's cvsroot. "cvs checkout src/AnalysisEnvironment". 1. Open vistrails_startup/startup.py and copy the parts that have changed to...
AnalysisEnvironmentGroup * Set GROUP = Main.ChrisDJones, Main.DevinBougie, Main.GregorySharp, Main.DanRiley, Main.ValentinKuznetsov, Main.AndrewDolgert * Set ...
The goal of this proposal is to reduce the amount of high level human intervention required in the EventStore data life cycle by automatically generating the spec...
CLEOc Data Path Specification The following elements were considered for inclusion in the data path spec: * Experiment: CLEO3, CLEOc * Source: detector (daq...
From www.cherrypy.org: CherryPy is a pythonic, object oriented web development framework. CherryPy allows developers to build web applications in much the same...
Group Todo List completed tasks List in reverse chronological order (i.e., add new entries at the top of the list) OSG Cluster * correct SE info in BDII? *...
Actor Goals for CMS DBS Here we write goals for known actors in order to get a sense both for the interfaces to the system and for a good granularity for use case...
Actors The CMS DBS is an internal actor in a much larger system. While other internal actors have already been identified, responsibilities and collaborators of t...
Business Rules 1. An experimental group will not publish data until it has written papers about it themselves. 1. For each new version of software, you have...
CSA06 Use Cases //TWikiDocGraphics/arrowup.gif DBS Requirements Description of CSA06 We will start with use cases for CSA06. The description on the CERN CSA06 wi...
Domain for CMS DBS Use Cases The basic processes of detector physics help name datasets and parts of datasets manipulated by the DBS. We provide a glossary here. ...
Nonfunctional Requirements for CMS DBS 1. There is a limit on how many events can be in a single job. 1. Tier 1 Production must continue if connection with ...
This section describes relataionship of DBS with other CMS sub systems. Definitions In General: DBS (Dataset Bookeeping Service) keeps a map of datasets to file ...
Scope We keep a quick reminder of the scope of these use cases at the top of our list. It should guide us in choosing which scenarios to pursue in detail and whic...
//TWikiDocGraphics/arrowup.gif DBS Requirements Usage Narratives and Use Cases for People Interacting with Data Management The usage narratives cover human inter...
Use Cases Usage Narratives These usage narratives are warm up for use cases. They cover some trivial and some interesting uses of the CMS Data Management System....
Outline of an Analysis of an Expected Signal (with blinding) Analysis Outline Define the Analysis * Signal: what physics process is being studied (e.g., H ...
Here are two views of the Energy Frontier workflow. The first is through file parentage, the second a picture of the ecosystem of the physicist. Parentage View I...
Characteristics of Energy Frontier Analysis Workflows The stages of a physics analysis in terms of "big picture" questions, but from a procedural perspective. Ea...
Event Store graph and injection policies This document describes the Event Store injection policies and provides outline of existing Event Store tables. The graph...
Event Store Administration Event Store (ES) administration is a most complicated and challenging task. It needs to deal with different underlying databases, a var...
This page records various design issues for the Event Store. 2005/05/09 * EventStore file format description: * binary_location_format.html: This is the des...
EventStore Schedule 0. Prerequisites things we need some agreement on early on; no product deployment is associated with this milestone. * Tools: * We...
Main.ValentinKuznetsov 01 Dec 2004 Missing features add skim listing within a grade for given (grade, time stamp) (done 2004/12/03) while executing eventstore c...
Group Todo List Completed tasks page CMSSW and FWLite Software Infrastructure * Improve FWLite/CINT exception handling * Access to high level data quality...
http://modeling.sourceforge.net/main.html The Modeling framework intends to fill the gap between the python object world and relational databases. It relies on a ...
Here is a incomplete list of Object Relational Mapping (ORM) Tools for python. * SQLObject * forgetSQL * SQLAlchemy * Modeling Object relation Bridge ...
Release changes 1. have lib*.so have the name of the release as part of its file name 1. have *.so have the name of the release as part of its file name ...
The production manager is processing requests and keeps tracj of allocated work based on requests by ProdAgent instances. For more information follow this link Fo...
PubDB is the Publication DB, originally developed for Production but now extended into the domain of WorkloadManagement. See description here Main.ValentinKuzne...
Python Web Service http://pywebsvcs.sourceforge.net : It is a library for developing web services. The libraries import protocols for SOAP, WSDL, and others. SO...
SQLAlchemy is the most promising ORM tool which supports a variety of DBs (SQLite, MySQL, Postrgres, ORACLE and MS SQL). The SQLAlchemy provides a layer between ...
Turbogears http://www.turbogears.org is a rapid development web application framework. It uses different building blocks: * MochiKit is a clean and powerful Ja...
Twisted is a networking engine written in Python, supporting numerous protocols. It contains a web server, numerous chat clients, chat servers, mail servers, and ...
Main.ChrisDJones 18 Dec 2004 * Defective.22615RENAMED.ppt: Powerpoint from Marc Paterno (on C committee) * AnalysisSupport.pdf: D0 and CDF experience from ...
This is a subscription service to be automatically notified by e mail when topics change in this HEP/SWIG web. This is a convenient service, so you do not have to...
HEP/SWIG Web Preferences The following settings are web preferences of the HEP/SWIG web. These preferences overwrite the site level preferences in ., and can be o...
Here you can find links to web services tools found on the web. List of python tools with their description: * Zope * Python Web Service * Webware for Py...
Webware for Python http://www.webwareforpython.org/ : It's a suite for developing object oriented, web based applications. It does object relational mapping, and ...
Zope http://zope.org : usually used for content management systems, this network application server platform includes a component for relational database mappin...