-
Couldn't load subscription status.
- Fork 84
Add Attachments processor class for handling ActivityPub media #2314
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: trunk
Are you sure you want to change the base?
Conversation
Introduces a new 'ap_object' post type and related taxonomies for handling ActivityPub objects, including registration, CRUD operations, and taxonomy management. Updates create and update handlers to process non-interaction objects using the new Objects collection. Enhances debug functionality to support the new post type and taxonomies.
Introduced Sanitize::content() to process and format content for ActivityPub, including block support and HTML sanitization. Updated Objects class to use the new sanitizer for post content.
Introduces a new Blocks::html_to_blocks() method to convert HTML content into block format using DOMDocument parsing and block mapping. Refactors Sanitize to use this new method, replacing the previous regex-based paragraph splitting logic for improved accuracy and maintainability.
The get_node_attributes private method was removed and the logic for setting the 'ordered' attribute on 'ol' nodes is now handled inline. This simplifies the code by reducing indirection and focusing only on the required attribute for ordered lists.
Refactored the Blocks class by renaming the html_to_blocks method to convert_from_html for improved clarity. Updated all references to use the new method name.
Co-authored-by: Copilot <[email protected]>
Co-authored-by: Copilot <[email protected]>
Co-authored-by: Copilot <[email protected]>
Introduces new PHPUnit tests for content sanitization in Sanitize::content, covering scenarios such as block support, malicious content, URLs, empty content, and safe HTML preservation. Also adds a test for Blocks::convert_from_html to verify HTML-to-block conversion when blocks are supported.
Introduces tests to verify content sanitization in Create handler, handling of private activities, and behavior with malformed object data. Also ensures required post types are registered during test setup.
Introduces a comprehensive PHPUnit test suite for the Activitypub\Collection\Objects class, covering object addition, updating, retrieval by GUID, and activity-to-post conversion, including edge cases and error handling. Mocks HTTP requests for remote actor fetching and ensures correct post type registration for test isolation.
Renamed update_actor and update_object to handle_actor_update and handle_object_update for improved clarity and consistency. Combined logic for handling object and interaction updates into handle_object_update. Updated corresponding test method names to match the new handler method names.
Changed the PHPUnit @Covers annotation from ::update_actor to ::handle_actor_update in Test_Update to accurately reflect the method being tested.
Changed the post type labels in the registration array from 'Posts'/'Post' to 'Objects'/'Object' to better reflect the content type.
Inserted a blank line after the use statements in class-update.php to improve code readability and adhere to coding standards.
Deleted the Blocks::convert_from_html method and its related test, and updated the Sanitize class to no longer convert HTML content to blocks. This simplifies content sanitization by removing automatic block conversion.
Refactored the Objects collection to Posts, updating class names, constants, and references in all relevant files. Adjusted post type from 'ap_object' to 'ap_post' and updated related taxonomy registrations, handlers, and tests to reflect the new naming convention. This improves clarity and consistency in the codebase.
Refactored the method name from create_object to create_post to better reflect its purpose of handling post creation. Updated all relevant references and docblocks for clarity.
Changed the @Covers annotation from ::create_object to ::create_post in the test_handle_create_object_with_sanitization method to accurately reflect the method being tested.
Adds registration of the '_activitypub_remote_actor_id' post meta for the custom post type, storing the local ID of the remote actor that created the object. This includes type enforcement, a description, and a sanitize callback.
The 'ap_object_type' taxonomy has been added to the registered taxonomies array for the relevant post type, allowing posts to be associated with both 'ap_tag' and 'ap_object_type'.
Deleted the 'labels' arrays from the registration of 'ap_tag' and 'ap_object_type' taxonomies. This will cause WordPress to use default labels for these taxonomies.
Eliminated the 'rewrite' arguments for 'ap_tag' and 'ap_object_type' taxonomies, reverting to default rewrite behavior. This may affect the URLs generated for these taxonomies.
Refactors the method name from handle_actor_update to update_actor for clarity and updates all references accordingly.
Renamed the test method from test_handle_actor_update to test_update_actor and updated the @Covers annotation and method calls to reference update_actor instead of handle_actor_update. This aligns the test with the updated function name.
Initializes $result as WP_Error by default and updates the docblock for the 'activitypub_handled_update' action to specify more precise types for the $result parameter. Removes unreachable assignment in the comment update branch.
Adds explicit WP_Error objects when Create or Update operations fail, ensuring consistent error reporting. Also updates the docblock for the Create handler to reflect possible result types.
Moved the default WP_Error assignment to the start of handle_object_update, ensuring $result is always initialized. Removed redundant error assignment after update attempts.
- Remove has_updated_attachments() method (was just an empty check) - Inline attachment check directly in update() method - Remove unused actor_id check (not needed for file-based storage) - Make ap_posts_dir property public for easier access in tests - Update tests to use public property instead of hardcoded paths - Add trailing slash to ap_posts_dir for consistency All 1212 tests passing.
Mastodon imported attachments should be visible in the user's media library since they're importing their own content. The method that was hiding them from the media library is no longer needed. All 1212 tests passing.
wp_mkdir_p() handles the existence check internally and will create parent directories (/activitypub/ap_posts/) with proper permissions inherited from the uploads directory. This should fix CI test failures where parent directories may not exist.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
Copilot reviewed 9 out of 9 changed files in this pull request and generated 3 comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Renamed variables from 'filename' and 'filepath' to 'file_name' and 'file_path' for consistency and clarity in the file handling logic within the Attachments class.
Co-authored-by: Copilot <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
Copilot reviewed 9 out of 9 changed files in this pull request and generated 3 comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Replace mime_content_type() with WordPress's wp_check_filetype_and_ext() to properly validate file types and detect mime types using WordPress standards. This provides better security by validating that file contents match their extensions and prevents mime type spoofing.
Replaces the 'delete_attachments_with_post' method with 'delete_directory' for post deletion cleanup. Renames media and file append helper methods for clarity and consistency.
This comment was marked as off-topic.
This comment was marked as off-topic.
- Replace generic import_files() with type-specific import_post_files() - Move orchestration logic to private import_files_for_object() - Make $object_type a required parameter in all helper methods - Add helper methods for content and storage path abstraction: - get_storage_paths() for directory path handling - get_object_content() for content retrieval - update_object_content() for content updates - Add public $comments_dir property for future comment support - Update call sites to use new import_post_files() method - Add cache clearing after attachment import to ensure fresh post data This refactoring makes it trivial to add comment attachment support in the future by adding import_comment_files() that calls the same private orchestration method.
|
@Jiwoon-Kim this is not directly related to this PR, can you please start this as discussion instead, to keep the focus on the code changes. |
|
@pfefferle This should be ready for another review |
Proposed changes:
Implements a dual storage strategy where Mastodon imports continue using WordPress attachment posts while
ActivityPub inbox items use direct file storage in
uploads/activitypub/ap_posts/{post_id}/.New methods added:
import_files()- Public method for direct file import (used by ap_posts)save_file()- Downloads and saves files touploads/activitypub/ap_posts/{post_id}/, returns array withurl,mime_type, andaltkeysimport_inline_files()- Processes inline images for file storageappend_files_to_content()- Appends file-based media to contentgenerate_files_markup()- Creates block markup from file dataget_files_gallery_block()- Gallery block for file-based attachmentsdelete_directory()- Public helper to delete post's file directoryMethods removed:
maybe_hide_from_media_library()- No longer needed, Mastodon import attachments should be visible in theuser's media library
has_updated_attachments()- Simplified to inline empty checkKey improvements:
$ap_posts_dirproperty for consistent path referencesOther information:
Testing instructions:
$ap_posts_dirproperty for path consistencyTechnical details:
The implementation uses a simple folder-per-post structure where each
ap_postgets its own directory atuploads/activitypub/ap_posts/{post_id}/. When a post is deleted, the entire directory is recursively removedusing
WP_Filesystem::delete().Files are tracked by the directory structure itself rather than post meta, keeping the implementation simple
and avoiding the need for complex deduplication logic.
Changelog entry
Changelog Entry Details
Significance
Type
Message
Use direct file storage for ActivityPub inbox attachments instead of creating WordPress attachment posts.
Mastodon imports continue using attachment posts as before.