AutoTest Design

Design Principle

Creation rules:

• If test code exists and LLM returns code with import statements, AutoDev will replace all existing code.
• If test code exists and LLM returns code without import statements, AutoDev will insert test code after the last import statement.
• If test code does not exist, AutoDev will directly insert the test code.

Execution rules:

• If a run configuration already exists, AutoDev will create a new run configuration.
• If no run configuration exists, AutoDev will create a new run configuration.

For implementation details, refer to AutoTestService

Test Prompts

    Write unit test for the following Kotlin code.
    
    You are working on a project that uses Spring MVC, Spring WebFlux to build RESTful APIs.
    - You MUST use should_xx_xx style for test method names, and follow given-when-then structure.
    - Test files must be complete and compilable without requiring additional modifications.
    - Ensure each test focuses on a single use case to maintain clarity and readability.
    - Instead of using `@BeforeEach` for setup, include all necessary initialization within individual test methods. Do not write parameterized tests.
    - This project uses JUnit 5 - import `org.junit.jupiter.api.Test` and use `@Test` annotation.
    - Use appropriate Spring test annotations: `@MockBean`, `@Autowired`, `@WebMvcTest`, `@DataJpaTest`, `@AutoConfigureTestDatabase`, `@AutoConfigureMockMvc`, `@SpringBootTest`, etc.
      Example template:
    \```Kotlin
    // You Must use @SpringBootTest(webEnvironment = SpringBootTest.WebEnvironment.RANDOM_PORT)
    @SpringBootTest(webEnvironment = SpringBootTest.WebEnvironment.RANDOM_PORT)
    @ExtendWith(SpringExtension::class)
    class PluginControllerTest {
    
        private lateinit var mockMvc: MockMvc
    
        @BeforeEach
        fun setup() {
            // Use MockMvcBuilders.standaloneSetup() to build mockMvc
            mockMvc = MockMvcBuilders.standaloneSetup(PluginController()).build()
        }
    
        @Test
        fun shouldReturnPluginTypes() {
            mockMvc.perform(get("/api/plugin/type"))
                .andExpect(status().isOk)
                .andExpect(jsonPath("$[0]").value("DUBBO"))
        }
    }
    
    \```
    
    - Kotlin API version: 1.9
    
    // Related classes:
    // 'package: com.thoughtworks.archguard.evolution.domain.BadSmellSuite
    // class BadSmellSuite {
    //   id
    //   suiteName
    //   isDefault
    //   thresholds
    //   
    // }
    // 'package: com.thoughtworks.archguard.evolution.domain.BadSmellSuiteWithSelected
    // class BadSmellSuiteWithSelected {
    //   id
    //   suiteName
    //   isDefault
    //   isSelected
    //   thresholds
    //   
    // }
    // 'package: com.thoughtworks.archguard.evolution.domain.BadSmellThresholdService
    // '@Service
    // class BadSmellThresholdService {
    //   badSmellSuitRepository
    //   + fun getAllSuits(): List<BadSmellSuite>
    //   + fun getBadSmellSuiteWithSelectedInfoBySystemId(systemId: Long): List<BadSmellSuiteWithSelected>
    // }
    
    // Current class information:
    // 'package: com.thoughtworks.archguard.evolution.controller.EvolutionBadSmellController
    // '@RestController, @RequestMapping("/api/evolution")
    // class EvolutionBadSmellController {
    //   badSmellThresholdService
    //   + @GetMapping("/badsmell-thresholds")     fun getAllThresholds(): List<BadSmellSuite>
    //   + @GetMapping("/badsmell-thresholds/system/{systemId}")     fun getThresholdsBySystemId(@PathVariable("systemId") systemId: Long): List<BadSmellSuiteWithSelected>
    // }
    
    Code:
    // import com.thoughtworks.archguard.evolution.domain.BadSmellSuite
    // import com.thoughtworks.archguard.evolution.domain.BadSmellSuiteWithSelected
    // import com.thoughtworks.archguard.evolution.domain.BadSmellThresholdService
    // import org.springframework.web.bind.annotation.GetMapping
    // import org.springframework.web.bind.annotation.PathVariable
    // import org.springframework.web.bind.annotation.RequestMapping
    // import org.springframework.web.bind.annotation.RestController
    \```kotlin
    @RestController
    @RequestMapping("/api/evolution")
    class EvolutionBadSmellController(val badSmellThresholdService: BadSmellThresholdService) {
    
        @GetMapping("/badsmell-thresholds")
        fun getAllThresholds(): List<BadSmellSuite> {
            return badSmellThresholdService.getAllSuits()
        }
    
        @GetMapping("/badsmell-thresholds/system/{systemId}")
        fun getThresholdsBySystemId(@PathVariable("systemId") systemId: Long): List<BadSmellSuiteWithSelected> {
            return badSmellThresholdService.getBadSmellSuiteWithSelectedInfoBySystemId(systemId)
        }
    }
    \```
    
    Start with `import` syntax here:

Resources

TestSpark

TestSpark currently supports two test generation strategies:

• LLM-based test generation (using OpenAI and JetBrains internal AI Assistant platform)
• Local search-based test generation (using EvoSuite)

Method 1: LLM generation prompt example

GitHub: TestSpark

Generate unit tests in $LANGUAGE for $NAME to achieve 100% line coverage for this class.
Dont use @Before and @After test methods.
Make tests as atomic as possible.
All tests should be for $TESTING_PLATFORM.
In case of mocking, use $MOCKING_FRAMEWORK. But, do not use mocking for all tests.
Name all methods according to the template - [MethodUnderTest][Scenario]Test, and use only English letters.
The source code of class under test is as follows:
$CODE
Here are some information about other methods and classes used by the class under test. Only use them for creating objects, not your own ideas.
$METHODS
$POLYMORPHISM
$TEST_SAMPLE

Method 2: EvoSuite generation

EvoSuite is a tool that automatically generates test cases with class assertions written in Java code.