Page History

This is continued from part 1

Rollup orgs

• Now we need a meta view which has information about the rollup group: note the top two levels are filtered out

  Code Block

  CREATE OR REPLACE FORCE VIEW ORG_LOADER_ROLLUP_META_V (    GROUP_NAME,    GROUP_DISPLAY_NAME,    GROUP_DESCRIPTION,    READERS,    VIEWERS,    ORG_ID,    GROUP_OVERALL_NAME,    PARENT_ID ) AS      SELECT DISTINCT                'penn:community:employee:org:'             || olv.org_name             || ':'             || olv.org_name             || '_rolluporg_systemOfRecord'                AS group_name,                'penn:community:employee:org:'             || olv.org_name             || ' - '             || olv.ORG_DISPLAY_NAME             || ':'             || olv.org_name             || ' - '             || olv.ORG_DISPLAY_NAME             || ' system of record'                AS group_display_name,                'Members of '             || olv.org_name             || ' and all groups underneath the hierarchy'                AS group_description,             'penn:community:employee:orgSecurity:orgReaders' AS readers,             'penn:community:employee:orgSecurity:orgViewers' AS viewers,             olv.org_name AS org_id,                'penn:community:employee:org:'             || olv.org_name             || ':'             || olv.org_name             || '_rolluporg'                AS group_overall_name,             olv.PARENT_ID        FROM org_list_v olv       WHERE     EXISTS                    (SELECT OLV2.ORG_NAME                       FROM org_list_v olv2                      WHERE OLV2.PARENT_ID = OLV.ORG_NAME)             AND olv.PAYROLL_FLAG = 'N'             AND olv.ORG_NAME NOT IN ('TOPU', 'UNIV', 'NOTU')    ORDER BY 2;

• This has data which looks like this:

• Now the rollups, make a view which assigns the rollup.  Note this is based on the meta view, so it only includes groups in the meta view

CREATE OR REPLACE FORCE VIEW ORG_LOADER_ROLLUP_V
(
     GROUPGROUP_NAME,
     MEMBERMEMBER_GROUP_NAME
)
   BEQUEATH DEFINER
AS
     (SELECT DISTINCT
           rollup           rollup_parent.GROUP_NAME AS group_name,
                      /* records which are rollups directly under the rollup */
           rollup           rollup_child.GROUP_OVERALL_NAME AS subject_identifier
         FROM ORG_LOADER_ROLLUP_META_V rollup_parent,
           ORG           ORG_LOADER_ROLLUP_META_V rollup_child
        WHEREWHERE rollup_child.PARENT_ID = rollup_parent.ORG_ID)
   UNION
     UNION
   /* payroll orgs (which hold people) directly under the rollup */
     (SELECT DISTINCT
           rollup           rollup_parent.GROUP_NAME,
                           'penn:community:employee:org:'
                      || olv_child.ORG_NAME
                      || ':'
                      || olv_child.ORG_NAME
             || '    || '_personorg'
                           AS subject_identifier
         FROM ORG_LOADER_ROLLUP_META_V rollup_parent, org_list_v olv_child
     WHERE     WHERE     olv_child.PARENT_ID = rollup_parent.org_id
           AND           AND olv_child.PAYROLL_FLAG = 'Y');

• The data for this view looks like this

• Use the rollup view, join to group id's

...

• The data from this view looks like

• Create the config group for the rollups, and execute the loader job

...

• There are 1461 rollup orgs, 407k memberships.  Here is a screen of the rollups orgs 
• Image Removed

• ---

  Image Added

...

Here are the immediate members of a rollup org (immediate rollups underneath, or person orgs if directly underneath) 
• Image Removed
• Here are all members in a rollup group
  *-- *--- Image Removed
  Image Added

...

Centers (can be high level orgs or across the hierarchy)

• Create a view of the list of centers

CREATE OR REPLACE FORCE VIEW ORG_CENTER_LIST_V
(
   CENTER_CODE,
   CENTER_NAME
)
AS
   SELECT DISTINCT olv.CENTER_CODE, olv.CENTER_NAME
     FROM org_list_v olv
    WHERE center_code IS NOT NULL;
COMMENT ON TABLE ORG_CENTER_LIST_V IS 'list of centers to make groups for';

• This data looks like

• Make a meta view aboup all the "center" groups

CREATE OR REPLACE FORCE VIEW ORG_CENTER_META_V
(
   GROUP_OVERALL_NAME,
   GROUP_NAME,
   GROUP_DISPLAY_NAME,
   GROUP_DESCRIPTION,
   READERS,
   VIEWERS,
   CENTER_CODE,
   CENTER_NAME
)
AS
   SELECT    'penn:community:employee:center:'
          || oclv.CENTER_CODE
          || '_center:'
          || oclv.CENTER_CODE
          || '_center'
             AS group_overall_name,
             'penn:community:employee:center:'
          || oclv.CENTER_CODE
          || '_center:'
          || oclv.CENTER_CODE
          || '_center_systemOfRecord'
             AS group_name,
             'penn:community:employee:center:'
          || oclv.CENTER_CODE
          || ' center '
          || oclv.CENTER_NAME
          || ':'
          || oclv.CENTER_CODE
          || ' center '
          || oclv.CENTER_NAME
          || ' system of record'
             AS group_display_name,
             'Center '
          || oclv.CENTER_CODE
          || ' '
          || oclv.CENTER_NAME
          || ' is a rollup of orgs and their includes/excludes'
             AS group_description,
          'penn:community:employee:orgSecurity:orgReaders' AS readers,
          'penn:community:employee:orgSecurity:orgViewers' AS viewers,
          center_code,
          center_name
     FROM org_center_list_v oclv;
COMMENT ON TABLE ORG_CENTER_META_V IS 'list of groups managed by the center loader job';

• This data looks like this
  
  
   

• Make a view of which children (org nodes) are in each center (direct children not grandchildren which will be effective members anyways)

CREATE OR REPLACE VIEW ORG_CENTER_ROLLUP_V
(GROUP_NAME, MEMBER_GROUP_NAME)
AS
(select distinct ocmv.GROUP_NAME as group_name,
/\* records which are rollups directly under the rollup \*/
rollup_child.GROUP_OVERALL_NAME as subject_identifier
from org_center_meta_v ocmv, ORG_LOADER_ROLLUP_META_V rollup_child, org_list_v olv_child
where olv_child.CENTER_CODE_ASSIGN = ocmv.CENTER_CODE and olv_child.ORG_NAME = rollup_child.ORG_ID )
union all
/\* payroll orgs (which hold people) directly under the rollup \*/
(select distinct ocmv.GROUP_NAME ,
olpmv.GROUP_NAME as subject_identifier
from org_center_meta_v ocmv, org_list_v olv_child, org_loader_person_meta_v olpmv
where olv_child.CENTER_CODE_ASSIGN = ocmv.CENTER_CODE and olv_child.ORG_NAME = olpmv.ORG_ID)

• This data looks like this

GROUP_NAME MEMBER_GROUP_NAME
penn:community:employee:center:86_center:86_center_systemOfRecord penn:community:employee:org:86XX:86XX_rolluporg

GROUP_OVERALL_NAME GROUP_NAME	 GROUP_DISPLAY_NAME GROUP_DESCRIPTION READERS VIEWERS CENTER_CODE CENTER_NAME
penn:community:employee:center:26_center:26_center penn:community:employee:center:26_center:26_center_systemOfRecord penn:community:employee:center:26 center University Museum:26 center University Museum system of record Center 26 University Museum is a rollup of orgs and their includes/excludes penn:community:employee:orgSecurity:orgReaders penn:community:employee:orgSecurity:orgViewers 26 University Museum
penn:community:employee:center:90_center:90_center penn:community:employee:center:90_center:90_center_systemOfRecord penn:community:employee:center:90 center Development and Alumni Relations:90 center Development and Alumni Relations system of record Center 90 Development and Alumni Relations is a rollup of orgs and their includes/excludes penn:community:employee:orgSecurity:orgReaders penn:community:employee:orgSecurity:orgViewers 90 Development and Alumni Relations
penn:community:employee:center:8798_center:8798_center_systemOfRecord penn:community:employee:org:98XX:98XX_rolluporg
penn:community:employee:center:8732_center:8732_center_systemOfRecord penn:community:employee:center:87 center Division of Finance:87 center Division of Finance system of record Center 87 Division of Finance is a rollup of orgs and their includes/excludes org:32XX:32XX_rolluporg
penn:community:employee:center:orgSecurity:orgReaders02_center:02_center_systemOfRecord penn:community:employee:orgSecurity:orgViewers 87 Division of Finance
penn:community:employee:center:99_center:99_center penn:community:employee:center:99_center:99_center_systemOfRecord penn:community:employee:center:99 center External Organizations Agency Funds:99 center External Organizations Agency Funds system of record Center 99 External Organizations Agency Funds is a rollup of orgs and their includes/excludes penn:community:employee:orgSecurity:orgReaders penn:community:employee:orgSecurity:orgViewers 99 External Organizations Agency Funds
penn:community:employee:center:91_center:91_center penn:community:employee:center:91_center:91_center_systemOfRecord penn:community:employee:center:91 center Information Systems and Computing:91 center Information Systems and Computing system of record Center 91 Information Systems and Computing is a rollup of orgs and their includes/excludes penn:community:employee:orgSecurity:orgReaders penn:community:employee:orgSecurity:orgViewers 91 Information Systems and Computing
penn:community:employee:center:79_center:79_center penn:community:employee:center:79_center:79_center_systemOfRecord penn:community:employee:center:79 center Division of Public Safety:79 center Division of Public Safety system of record Center 79 Division of Public Safety is a rollup of orgs and their includes/excludes penn:community:employee:orgSecurity:orgReaders penn:community:employee:orgSecurity:orgViewers 79 Division of Public Safety

• Make a view of which children (org nodes) are in each center (direct children not grandchildren which will be effective members anyways)

CREATE OR REPLACE VIEW ORG_CENTER_ROLLUP_V
(GROUP_NAME, MEMBER_GROUP_NAME)
AS
(select distinct ocmv.GROUP_NAME as group_name,
/\* records which are rollups directly under the rollup \*/
rollup_child.GROUP_OVERALL_NAME as subject_identifier
from org_center_meta_v ocmv, ORG_LOADER_ROLLUP_META_V rollup_child, org_list_v olv_child
where olv_child.CENTER_CODE_ASSIGN = ocmv.CENTER_CODE and olv_child.ORG_NAME = rollup_child.ORG_ID )
union all
/\* payroll orgs (which hold people) directly under the rollup \*/
(select distinct ocmv.GROUP_NAME ,
olpmv.GROUP_NAME as subject_identifier
from org_center_meta_v ocmv, org_list_v olv_child, org_loader_person_meta_v olpmv
where olv_child.CENTER_CODE_ASSIGN = ocmv.CENTER_CODE and olv_child.ORG_NAME = olpmv.ORG_ID)

• This data looks like this

GROUP_NAME MEMBER_GROUP_NAME
penn:community:employee:center:86_center:86_center_systemOfRecord penn:community:employee:org:86XX:86XX_rolluporg
penn:community:employee:center:98_center:98_center_systemOfRecord penn:community:employee:org:98XX:98XX_rolluporg
penn:community:employee:center:32_center:32_center_systemOfRecord penn:community:employee:org:32XX:32XX_rolluporg
penn:community:employee:center:02_center:02_center_systemOfRecord penn:community:employee:org:0120:0120_personorg

• Join this with the grouper registry to get the group ids

CREATE OR REPLACE VIEW ORG_CENTER_ROLLUP2_V
(GROUP_NAME, SUBJECT_ID, SUBJECT_SOURCE_ID, SUBJECT_GROUP_NAME)
AS
select ocrv.GROUP_NAME group_name, ga.GROUP_ID as subject_id, 'g:gsa' as SUBJECT_SOURCE_ID,
ocrv.MEMBER_GROUP_NAME subject_group_name
from org_center_rollup_v ocrv, grouper_attributes ga, grouper_fields gf
where gf.NAME = 'name' AND gf.ID = ga.field_id and ga.VALUE = ocrv.MEMBER_GROUP_NAME

• This data looks like this

...

org:0120:0120_personorg

• Join this with the grouper registry to get the group ids

CREATE OR REPLACE VIEW ORG_CENTER_ROLLUP2_V
(GROUP_NAME, SUBJECT_ID, SUBJECT_SOURCE_ID, SUBJECT_GROUP_NAME)
AS
select ocrv.GROUP_NAME group_name, ga.GROUP_ID as subject_id, 'g:gsa' as SUBJECT_SOURCE_ID,
ocrv.MEMBER_GROUP_NAME subject_group_name
from org_center_rollup_v ocrv, grouper_attributes ga, grouper_fields gf
where gf.NAME = 'name' AND gf.ID = ga.field_id and ga.VALUE = ocrv.MEMBER_GROUP_NAME

• This data looks like this
  
  

  GROUP_OVERALL_NAME	GROUP_NAME	GROUP_DISPLAY_NAME	GROUP_DESCRIPTION	READERS	VIEWERS	CENTER_CODE	CENTER_NAME
  penn:community:employee:center:

...

• 22_center:

...

• 22_center

...

• penn:community:employee:

...

• center:

...

• 22_center:

...

• 22_center_systemOfRecord

...

• penn:community:employee:center:

...

• 22 center Domestic Subsidiaries:

...

• 22 center Domestic Subsidiaries system of record

  Center 22 Domestic Subsidiaries is a rollup of orgs and their includes/excludes

  penn:community:employee:

...

• orgSecurity:orgReaders

  penn:community:employee:

...

• orgSecurity:orgViewers

  22

  Domestic Subsidiaries

  Add this config group

• Code Block

  gsh 4% centerGroup = addGroup("penn:community:employee", "centerRollupConfig", "centerRollupConfig"); group: name='penn:community:employee:centerRollupConfig' displayName='penn:community:employee:centerRollupConfig' uuid='8b329babf720413d81f5004fb3729c02' gsh 6% groupAddType("penn:community:employee:centerRollupConfig", "grouperLoader"); true gsh 7% setGroupAttr("penn:community:employee:centerRollupConfig", "grouperLoaderDbName", "grouper"); true gsh 8% setGroupAttr("penn:community:employee:centerRollupConfig", "grouperLoaderQuartzCron", "0 36 7 * * ? "); true gsh 9% setGroupAttr("penn:community:employee:centerRollupConfig", "grouperLoaderQuery", "select GROUP_NAME, SUBJECT_ID, SUBJECT_SOURCE_ID from ORG_CENTER_ROLLUP2_V"); true gsh 10% setGroupAttr("penn:community:employee:centerRollupConfig", "grouperLoaderScheduleType", "CRON"); true gsh 12% setGroupAttr("penn:community:employee:centerRollupConfig", "grouperLoaderType", "SQL_GROUP_LIST"); true gsh 13% setGroupAttr("penn:community:employee:centerRollupConfig", "grouperLoaderGroupQuery", "select group_name, group_display_name, group_description, readers, viewers from org_center_meta_v"); true gsh 14% setGroupAttr("penn:community:employee:centerRollupConfig", "grouperLoaderGroupsLike", "penn:community:employee:center:%_center_systemOfRecord"); true gsh 15% setGroupAttr("penn:community:employee:centerRollupConfig", "grouperLoaderGroupTypes", "addIncludeExclude"); true gsh 18% centerGroup = GroupFinder.findByName(grouperSession, "penn:community:employee:centerRollupConfig"); group: name='penn:community:employee:centerRollupConfig' displayName='penn:community:employee:centerRollupConfig' uuid='8b329babf720413d81f5004fb3729c02' gsh 19% loaderRunOneJob(centerGroup);

  Add this config group

...

• This created 41 centers, with 91k membership.  Here are the centers
  *-- *--- Image Removed
  Image Added
  
  

  ---

• Here is a look at one center
  *-- *--- Image Removed
  Image Added
  
  

...

• Here are all members of a center
  Image Removed
  Image Added
  
  

  ---

  Contractors and one-offs

We dont have groupings of contractors in our payroll system, but we can set a flag in "Penn Community" our person database.  So lets organize a way to automatically make groups based on flags.  Lets make a table which identifies the flags we are looking for, and which group extension

...

• Add the VP to the includes list of the org.  Note, this means that for all purposes, additions are considered part of the org, and part of the center (since the org is part of the center)
  • • • 

        ---

• Now make a group which has the org group, and the consultants
  • • • 

        ---

• Here are the two members
  • • • 

        ---

• Here are all members
  • • • 

        ---

• Protect a web resource in apache by requiring members to be in this group (note: authnz_ldap apache module grabs all members of the group unless a patch is applied that Penn developed which is not yet public)

  Code Block

  <Directory "[directory]"> CosignProtected on AuthType Cosign CosignRequireFactor UPENN.EDU AuthzLDAPAuthoritative on AuthLDAPCompareDNOnServer on AuthLDAPBindPassword [password] AuthLDAPBindDN uid=[service principal],ou=entities,dc=upenn,dc=edu AuthLDAPLimitAttribute cn # custom attribute via local patch AuthLDAPURL ldaps://url.ldap.private/cn=penn:community:employee:org:96XX:96XX_andConsultants,ou=groups,dc=upenn,dc=edu?hasMember require ldap-dn cn=penn:community:employee:96XX:96XX_andConsultants,ou=groups,dc=upenn,dc=edu </Directory>